[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:15 dist-test-slave-njxd krb5kdc[18170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:15 dist-test-slave-njxd krb5kdc[18170](info): set up 2 sockets
Aug 11 04:48:15 dist-test-slave-njxd krb5kdc[18170](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 04:48:16.458205 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.122s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:16 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:16.596278 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42161
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:40771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42161
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:16.716894 18185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:16.717267 18185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:16.717360 18185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:16.721503 18185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:16.721658 18185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:16.721704 18185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:16.721731 18185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:16.721771 18185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:16.727332 18185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:40771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42161
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:16.728562 18185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:16.729733 18185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:16.738864 18193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:16.738864 18190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:16.738899 18191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:16.739070 18185 server_base.cc:1034] running on GCE node
I20260811 04:48:16.739864 18185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:16.740993 18185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:16.742158 18185 hybrid_clock.cc:648] HybridClock initialized: now 1786423696742139 us; error 32 us; skew 500 ppm
Aug 11 04:48:16 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423696, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:16.745150 18185 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:16.746272 18185 webserver.cc:460] Webserver started at http://127.17.188.126:32833/ using document root <none> and password file <none>
I20260811 04:48:16.746902 18185 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:16.747001 18185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:16.747253 18185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:16.749430 18185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "da1ca4ccc43346949d78b6223c23f94a"
format_stamp: "Formatted at 2026-08-11 04:48:16 on dist-test-slave-njxd"
server_key: "a7c002a286e857f89033f14347f70cf7"
server_key_iv: "15fc60d15f71e0d63f95afa21bf59f6c"
server_key_version: "encryptionkey@0"
I20260811 04:48:16.750108 18185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "da1ca4ccc43346949d78b6223c23f94a"
format_stamp: "Formatted at 2026-08-11 04:48:16 on dist-test-slave-njxd"
server_key: "a7c002a286e857f89033f14347f70cf7"
server_key_iv: "15fc60d15f71e0d63f95afa21bf59f6c"
server_key_version: "encryptionkey@0"
I20260811 04:48:16.754616 18185 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:16.757385 18200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:16.758824 18185 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:48:16.759002 18185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "da1ca4ccc43346949d78b6223c23f94a"
format_stamp: "Formatted at 2026-08-11 04:48:16 on dist-test-slave-njxd"
server_key: "a7c002a286e857f89033f14347f70cf7"
server_key_iv: "15fc60d15f71e0d63f95afa21bf59f6c"
server_key_version: "encryptionkey@0"
I20260811 04:48:16.759142 18185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:16.776892 18185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:16.780344 18185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:16.780609 18185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:16.793480 18185 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:42161
I20260811 04:48:16.793638 18260 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:42161 every 8 connection(s)
I20260811 04:48:16.794809 18185 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:16.798075 18261 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:16.804137 18261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a: Bootstrap starting.
I20260811 04:48:16.804692 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18185
I20260811 04:48:16.804857 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:16.806303 18161 external_mini_cluster.cc:1428] Setting key 8dea2888acc27dd2ba19db696ddd26dd
I20260811 04:48:16.807104 18261 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:16.807878 18261 log.cc:824] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:16.810523 18261 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a: No bootstrap required, opened a new log
I20260811 04:48:16.814802 18261 raft_consensus.cc:348] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } }
I20260811 04:48:16.815120 18261 raft_consensus.cc:374] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:16.815176 18261 raft_consensus.cc:729] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da1ca4ccc43346949d78b6223c23f94a, State: Initialized, Role: FOLLOWER
I20260811 04:48:16.815680 18261 consensus_queue.cc:260] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } }
I20260811 04:48:16.815812 18261 raft_consensus.cc:388] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:16.815902 18261 raft_consensus.cc:482] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:16.816022 18261 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:16.817353 18261 raft_consensus.cc:504] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } }
I20260811 04:48:16.817735 18261 leader_election.cc:302] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da1ca4ccc43346949d78b6223c23f94a; no voters:
I20260811 04:48:16.818064 18261 leader_election.cc:288] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:16.818190 18267 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:16.818449 18267 raft_consensus.cc:686] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [term 1 LEADER]: Becoming Leader. State: Replica: da1ca4ccc43346949d78b6223c23f94a, State: Running, Role: LEADER
I20260811 04:48:16.818845 18267 consensus_queue.cc:237] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } }
I20260811 04:48:16.819413 18261 sys_catalog.cc:564] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:16.821179 18268 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da1ca4ccc43346949d78b6223c23f94a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } } }
I20260811 04:48:16.821359 18268 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:16.821269 18269 sys_catalog.cc:455] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [sys.catalog]: SysCatalogTable state changed. Reason: New leader da1ca4ccc43346949d78b6223c23f94a. Latest consensus state: current_term: 1 leader_uuid: "da1ca4ccc43346949d78b6223c23f94a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da1ca4ccc43346949d78b6223c23f94a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42161 } } }
I20260811 04:48:16.821996 18269 sys_catalog.cc:458] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:16.822314 18275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:16.826164 18275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 04:48:16 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:16.833904 18275 catalog_manager.cc:1347] Generated new cluster ID: 024bc2beb69a4492abd5d150169044d1
I20260811 04:48:16.833983 18275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:16.837126 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:16.809537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57528 (local address 127.17.188.126:42161)
0811 04:48:16.810144 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:16.810168 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:16.811372 (+ 1204us) server_negotiation.cc:407] Connection header received
0811 04:48:16.814285 (+ 2913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:16.814304 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:16.814742 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:16.815144 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:16.818430 (+ 3286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:16.820285 (+ 1855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:16.822416 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:16.823200 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:16.823362 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:16.829726 (+ 6364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:16.829732 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:16.829746 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:16.829778 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:16.832179 (+ 2401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:16.832788 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:16.832793 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:16.832797 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:16.832917 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:16.833297 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:16.833303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:16.833309 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:16.834098 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:16.835404 (+ 1306us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:16.835597 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 04:48:16.835881 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":141,"threads_started":1}
I20260811 04:48:16.843266 18275 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:16.844151 18275 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:16.853698 18275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da1ca4ccc43346949d78b6223c23f94a: Generated new TSK 0
I20260811 04:48:16.854511 18275 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:16.897531 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:40771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:17.061489 18288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:17.061865 18288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:17.061969 18288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:17.066414 18288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:17.066524 18288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:17.066624 18288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:17.075037 18288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:40771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:17.076639 18288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:17.078186 18288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:17.089084 18293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:17.089059 18294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:17.089082 18296 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:17.089481 18288 server_base.cc:1034] running on GCE node
I20260811 04:48:17.089982 18288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:17.090665 18288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:17.091856 18288 hybrid_clock.cc:648] HybridClock initialized: now 1786423697091821 us; error 50 us; skew 500 ppm
Aug 11 04:48:17 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423697, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:17.095484 18288 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:17.096462 18288 webserver.cc:460] Webserver started at http://127.17.188.65:35883/ using document root <none> and password file <none>
I20260811 04:48:17.097056 18288 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:17.097151 18288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:17.097394 18288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:17.099748 18288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "3ce10bdde19443a38318e232f6037419"
format_stamp: "Formatted at 2026-08-11 04:48:17 on dist-test-slave-njxd"
server_key: "0fedabc8912bbe2b0d693bf1a29fa7d1"
server_key_iv: "58d5f5b937507a3d3cf3382d1cbb7b2c"
server_key_version: "encryptionkey@0"
I20260811 04:48:17.100435 18288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "3ce10bdde19443a38318e232f6037419"
format_stamp: "Formatted at 2026-08-11 04:48:17 on dist-test-slave-njxd"
server_key: "0fedabc8912bbe2b0d693bf1a29fa7d1"
server_key_iv: "58d5f5b937507a3d3cf3382d1cbb7b2c"
server_key_version: "encryptionkey@0"
I20260811 04:48:17.104355 18288 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 04:48:17.106910 18304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:17.108206 18288 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:17.108351 18288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "3ce10bdde19443a38318e232f6037419"
format_stamp: "Formatted at 2026-08-11 04:48:17 on dist-test-slave-njxd"
server_key: "0fedabc8912bbe2b0d693bf1a29fa7d1"
server_key_iv: "58d5f5b937507a3d3cf3382d1cbb7b2c"
server_key_version: "encryptionkey@0"
I20260811 04:48:17.108465 18288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:17.122596 18288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:17.126010 18288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:17.126312 18288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:17.127112 18288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:17.128077 18288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:17.128149 18288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:17.128227 18288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:17.128271 18288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:17.146720 18288 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:33461
I20260811 04:48:17.146939 18435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:33461 every 8 connection(s)
I20260811 04:48:17.147783 18288 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:17.148437 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18288
I20260811 04:48:17.148572 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:17.148895 18161 external_mini_cluster.cc:1428] Setting key 25c781e2bb019401274311db88b58dfb
Aug 11 04:48:17 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423697, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:17.169930 18265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:17.149983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:49757 (local address 127.17.188.126:42161)
0811 04:48:17.150139 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:17.150144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:17.151255 (+ 1111us) server_negotiation.cc:407] Connection header received
0811 04:48:17.153662 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:17.153682 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:17.153759 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:17.153882 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:17.156018 (+ 2136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:17.156884 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:17.158661 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:17.159054 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:17.159152 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:17.164809 (+ 5657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:17.164813 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:17.164816 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:17.164857 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:17.166781 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:17.167411 (+ 630us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:17.167416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:17.167421 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:17.167521 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:17.168070 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:17.168076 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:17.168080 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:17.168364 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:17.168466 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:17.169364 (+ 898us) server_negotiation.cc:299] Negotiation successful
0811 04:48:17.169632 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:48:17.171209 18438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:17.150488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42161 (local address 127.17.188.65:49757)
0811 04:48:17.151065 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:17.151130 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:17.153259 (+ 2129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:17.154149 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:17.154162 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:17.154922 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:17.155847 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:17.155866 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:17.157019 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:17.157022 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:17.158488 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:17.158503 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:17.159386 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:17.159393 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:17.159716 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:17.162082 (+ 2366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:17.162120 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:17.164559 (+ 2439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:17.166948 (+ 2389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:17.166956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:17.166975 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:17.167291 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:17.167684 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:17.167690 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:17.167695 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:17.167939 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:17.168580 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:17.168590 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:17.169005 (+ 415us) client_negotiation.cc:769] Sending connection context
0811 04:48:17.169235 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 04:48:17.169688 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":150,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:17.172878 18436 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42161
I20260811 04:48:17.173969 18436 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:17.174953 18436 heartbeater.cc:511] Master 127.17.188.126:42161 requested a full tablet report, sending...
I20260811 04:48:17.177495 18219 ts_manager.cc:194] Registered new tserver with Master: 3ce10bdde19443a38318e232f6037419 (127.17.188.65:33461)
I20260811 04:48:17.179419 18219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:49757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
W20260811 04:48:18.163000 18161 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.17.188.66: real 1.012s user 0.001s sys 0.005s
I20260811 04:48:18.163751 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:40771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:48:18.182806 18436 heartbeater.cc:503] Master 127.17.188.126:42161 was elected leader, sending a full tablet report...
W20260811 04:48:18.331084 18441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:18.331410 18441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:18.331492 18441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:18.335892 18441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:18.335963 18441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:18.336054 18441 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:18.342020 18441 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:40771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:18.343276 18441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:18.344410 18441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:18.356513 18449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:18.356540 18446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:18.356438 18447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:18.357142 18441 server_base.cc:1034] running on GCE node
I20260811 04:48:18.357550 18441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:18.358268 18441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:18.359459 18441 hybrid_clock.cc:648] HybridClock initialized: now 1786423698359430 us; error 46 us; skew 500 ppm
Aug 11 04:48:18 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423698, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:18.362327 18441 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:18.363303 18441 webserver.cc:460] Webserver started at http://127.17.188.66:35779/ using document root <none> and password file <none>
I20260811 04:48:18.363933 18441 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:18.364041 18441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:18.364286 18441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:18.366456 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "8f9731a6488a4cd4ba18d22d00cfbb8c"
format_stamp: "Formatted at 2026-08-11 04:48:18 on dist-test-slave-njxd"
server_key: "ddbd12267a9095488c72cedaca7c5aaf"
server_key_iv: "daf963d0884222c22050596c14ec6c9a"
server_key_version: "encryptionkey@0"
I20260811 04:48:18.367064 18441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "8f9731a6488a4cd4ba18d22d00cfbb8c"
format_stamp: "Formatted at 2026-08-11 04:48:18 on dist-test-slave-njxd"
server_key: "ddbd12267a9095488c72cedaca7c5aaf"
server_key_iv: "daf963d0884222c22050596c14ec6c9a"
server_key_version: "encryptionkey@0"
I20260811 04:48:18.371323 18441 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:18.373903 18459 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:18.375188 18441 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:18.375329 18441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "8f9731a6488a4cd4ba18d22d00cfbb8c"
format_stamp: "Formatted at 2026-08-11 04:48:18 on dist-test-slave-njxd"
server_key: "ddbd12267a9095488c72cedaca7c5aaf"
server_key_iv: "daf963d0884222c22050596c14ec6c9a"
server_key_version: "encryptionkey@0"
I20260811 04:48:18.375455 18441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:18.391393 18441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:18.394570 18441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:18.394799 18441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:18.395502 18441 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:18.396471 18441 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:18.396546 18441 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:18.396628 18441 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:18.396687 18441 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:18.415848 18441 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38467
I20260811 04:48:18.415970 18589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38467 every 8 connection(s)
I20260811 04:48:18.416920 18441 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:18.422593 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18441
I20260811 04:48:18.422731 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:18.423034 18161 external_mini_cluster.cc:1428] Setting key f797380c50babf62a658e4f0e0567085
Aug 11 04:48:18 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423698, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:18.434356 18592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:18.419056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:39205 (local address 127.17.188.126:42161)
0811 04:48:18.419380 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:18.419385 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:18.420846 (+ 1461us) server_negotiation.cc:407] Connection header received
0811 04:48:18.422277 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:18.422281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:18.422348 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:18.422437 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:18.424283 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:18.424968 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:18.426364 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:18.426678 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:18.426796 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:18.430027 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:18.430031 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:18.430034 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:18.430070 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:18.431869 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:18.432475 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:18.432478 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:18.432479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:18.432570 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:18.432976 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:18.432979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:18.432981 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:18.433247 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:18.433360 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:18.433992 (+ 632us) server_negotiation.cc:299] Negotiation successful
0811 04:48:18.434151 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":148,"threads_started":1}
I20260811 04:48:18.435302 18593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:18.419425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42161 (local address 127.17.188.66:39205)
0811 04:48:18.420672 (+ 1247us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:18.420721 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:18.422040 (+ 1319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:18.422634 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:18.422642 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:18.423366 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:18.424105 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:18.424122 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:18.425107 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:18.425111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:18.426225 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:18.426236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:18.426846 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:18.426850 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:18.427095 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:18.427802 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:18.427819 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:18.429823 (+ 2004us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:18.432015 (+ 2192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:18.432022 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:18.432040 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:18.432342 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:18.432672 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:18.432675 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:18.432678 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:18.432861 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:18.433359 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:18.433368 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:18.433725 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 04:48:18.433928 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 04:48:18.434291 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":738,"threads_started":1}
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:18.436950 18590 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42161
I20260811 04:48:18.437263 18590 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:18.437825 18590 heartbeater.cc:511] Master 127.17.188.126:42161 requested a full tablet report, sending...
I20260811 04:48:18.438947 18219 ts_manager.cc:194] Registered new tserver with Master: 8f9731a6488a4cd4ba18d22d00cfbb8c (127.17.188.66:38467)
I20260811 04:48:18.439594 18219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:39205
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
W20260811 04:48:18.966053 18161 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.17.188.67: real 0.541s user 0.000s sys 0.005s
I20260811 04:48:18.966542 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:40771
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:19.118888 18596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:19.119148 18596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:19.119194 18596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:19.123346 18596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:19.123406 18596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:19.123466 18596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:19.128859 18596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:40771
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42161
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:19.129853 18596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:19.130820 18596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:19.141791 18602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:19.141804 18603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:19.141840 18605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:19.142010 18596 server_base.cc:1034] running on GCE node
I20260811 04:48:19.142679 18596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:19.143276 18596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:19.144465 18596 hybrid_clock.cc:648] HybridClock initialized: now 1786423699144441 us; error 34 us; skew 500 ppm
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:19.147887 18596 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:19.148790 18596 webserver.cc:460] Webserver started at http://127.17.188.67:40483/ using document root <none> and password file <none>
I20260811 04:48:19.149344 18596 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:19.149402 18596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:19.149683 18596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:19.151834 18596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "5bfc448251074b69bbc689b57b2e1085"
format_stamp: "Formatted at 2026-08-11 04:48:19 on dist-test-slave-njxd"
server_key: "960ac406491018b2bbc847585f5211a0"
server_key_iv: "a8d6cdb50c82053395906846a2ce392e"
server_key_version: "encryptionkey@0"
I20260811 04:48:19.152426 18596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "5bfc448251074b69bbc689b57b2e1085"
format_stamp: "Formatted at 2026-08-11 04:48:19 on dist-test-slave-njxd"
server_key: "960ac406491018b2bbc847585f5211a0"
server_key_iv: "a8d6cdb50c82053395906846a2ce392e"
server_key_version: "encryptionkey@0"
I20260811 04:48:19.156301 18596 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 04:48:19.159098 18612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:19.160326 18596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:19.160452 18596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "5bfc448251074b69bbc689b57b2e1085"
format_stamp: "Formatted at 2026-08-11 04:48:19 on dist-test-slave-njxd"
server_key: "960ac406491018b2bbc847585f5211a0"
server_key_iv: "a8d6cdb50c82053395906846a2ce392e"
server_key_version: "encryptionkey@0"
I20260811 04:48:19.160557 18596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:19.186357 18596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:19.189392 18596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:19.189688 18596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:19.190465 18596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:19.191373 18596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:19.191421 18596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:19.191488 18596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:19.191524 18596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:19.210268 18596 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:35387
I20260811 04:48:19.210426 18744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:35387 every 8 connection(s)
I20260811 04:48:19.211493 18596 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:19.215159 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18596
I20260811 04:48:19.215292 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:19.215584 18161 external_mini_cluster.cc:1428] Setting key bc20ee2c633a329891e26d7275783b8a
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:19.231557 18747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:19.214115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:37539 (local address 127.17.188.126:42161)
0811 04:48:19.214371 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:19.214375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:19.215292 (+ 917us) server_negotiation.cc:407] Connection header received
0811 04:48:19.217133 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:19.217136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:19.217199 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:19.217282 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:19.218635 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.219187 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.220671 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.220893 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.220973 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:19.227776 (+ 6803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:19.227779 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:19.227781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:19.227806 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:19.229391 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.229976 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.229980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.229982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.230073 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.230436 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.230439 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.230440 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.230635 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:19.230745 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:19.231243 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 04:48:19.231370 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":70,"threads_started":1}
I20260811 04:48:19.232437 18748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:19.214477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42161 (local address 127.17.188.67:37539)
0811 04:48:19.215139 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:19.215186 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:19.216911 (+ 1725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:19.217455 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:19.217462 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:19.217968 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:19.218483 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:19.218497 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.219360 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.219364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:19.220554 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:19.220565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.221060 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.221064 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:19.221267 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:19.225877 (+ 4610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:19.225894 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:19.227593 (+ 1699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:19.229521 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:19.229527 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:19.229542 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:19.229867 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:19.230179 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:19.230182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:19.230184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:19.230330 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:19.230745 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:19.230752 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:19.230994 (+ 242us) client_negotiation.cc:769] Sending connection context
0811 04:48:19.231185 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 04:48:19.231510 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":186,"threads_started":1}
I20260811 04:48:19.233657 18745 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42161
I20260811 04:48:19.233925 18745 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:19.234440 18745 heartbeater.cc:511] Master 127.17.188.126:42161 requested a full tablet report, sending...
I20260811 04:48:19.235411 18219 ts_manager.cc:194] Registered new tserver with Master: 5bfc448251074b69bbc689b57b2e1085 (127.17.188.67:35387)
I20260811 04:48:19.236011 18219 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:37539
I20260811 04:48:19.241636 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:19.270933 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:19.260558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48748 (local address 127.17.188.65:33461)
0811 04:48:19.260924 (+ 366us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:19.260932 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:19.261078 (+ 146us) server_negotiation.cc:407] Connection header received
0811 04:48:19.261267 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:19.261272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:19.261469 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:19.261647 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:19.262513 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.263461 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.264488 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.264988 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.265140 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:19.267532 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:19.267541 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:19.267556 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:19.267581 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:19.269349 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.269805 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.269810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.269811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.269897 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.270113 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.270115 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.270116 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.270338 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:19.270504 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:19.270660 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 04:48:19.270784 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253,"thread_start_us":69,"threads_started":1}
W20260811 04:48:19.271950 18337 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48748
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18170](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:19.300357 18756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:19.291935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.17.188.65:33461)
0811 04:48:19.292123 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:19.292128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:19.292258 (+ 130us) server_negotiation.cc:407] Connection header received
0811 04:48:19.292424 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:19.292428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:19.292480 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:19.292572 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:19.293276 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.293926 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.294810 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:19.295048 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:19.295163 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:19.297469 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:19.297472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:19.297475 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:19.297497 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:19.298978 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.299330 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.299332 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.299333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.299400 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:19.299639 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:19.299641 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:19.299643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:19.299784 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:19.299889 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:19.300055 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 04:48:19.300146 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 04:48:19.301335 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18288
I20260811 04:48:19.309682 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18441
I20260811 04:48:19.317407 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18596
I20260811 04:48:19.323894 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18185
2026-08-11T04:48:19Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4021 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18763](info): set up 2 sockets
Aug 11 04:48:19 dist-test-slave-njxd krb5kdc[18763](info): commencing operation
krb5kdc: starting...
W20260811 04:48:20.423650 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:20 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:20.549188 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:33621
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:33621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:20.659958 18779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:20.660308 18779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:20.660395 18779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:20.664480 18779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:20.664580 18779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:20.664618 18779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:20.664672 18779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:20.664712 18779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:20.670097 18779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:33621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:33621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:20.671271 18779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:20.672351 18779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:20.681092 18779 server_base.cc:1034] running on GCE node
W20260811 04:48:20.681036 18788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:20.681036 18786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:20.681048 18784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:20.681933 18779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:20.683091 18779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:20.684266 18779 hybrid_clock.cc:648] HybridClock initialized: now 1786423700684249 us; error 30 us; skew 500 ppm
Aug 11 04:48:20 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:20.687114 18779 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:20.687927 18779 webserver.cc:460] Webserver started at http://127.17.188.126:42951/ using document root <none> and password file <none>
I20260811 04:48:20.688446 18779 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:20.688503 18779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:20.688671 18779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:20.690802 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "c6fb0440d4254fa6aa4007a6421b4263"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "cf1aa6c88f278be4d3749b8bf81d94e6"
server_key_iv: "f29f182f7a3e8178e24a7b5b1dd07bb6"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.691344 18779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "c6fb0440d4254fa6aa4007a6421b4263"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "cf1aa6c88f278be4d3749b8bf81d94e6"
server_key_iv: "f29f182f7a3e8178e24a7b5b1dd07bb6"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.695182 18779 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:20.697718 18795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:20.699033 18779 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:20.699198 18779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "c6fb0440d4254fa6aa4007a6421b4263"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "cf1aa6c88f278be4d3749b8bf81d94e6"
server_key_iv: "f29f182f7a3e8178e24a7b5b1dd07bb6"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.699326 18779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:20.712090 18779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:20.715080 18779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:20.715293 18779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:20.722311 18779 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:33621
I20260811 04:48:20.722378 18852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:33621 every 8 connection(s)
I20260811 04:48:20.723416 18779 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:20.725342 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18779
I20260811 04:48:20.725457 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:20.725769 18161 external_mini_cluster.cc:1428] Setting key e5308ce2a50da1cef95eb1a1d237becc
I20260811 04:48:20.726514 18854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:20.733916 18854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263: Bootstrap starting.
Aug 11 04:48:20 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:20.736455 18854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:20.737246 18854 log.cc:824] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:20.739586 18854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263: No bootstrap required, opened a new log
I20260811 04:48:20.740345 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:20.727276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47052 (local address 127.17.188.126:33621)
0811 04:48:20.727752 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:20.727767 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:20.727803 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:48:20.728430 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:20.728445 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:20.728773 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:20.729048 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:20.730036 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:20.731031 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:20.732197 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:20.732678 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:20.732795 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:20.735630 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:20.735635 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:20.735647 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:20.735674 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:20.737348 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:20.737930 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:20.737938 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:20.737947 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:20.738103 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:20.738425 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:20.738427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:20.738428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:20.738805 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:20.738952 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:20.739256 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 04:48:20.739565 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":154,"threads_started":1}
I20260811 04:48:20.743736 18854 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } }
I20260811 04:48:20.743983 18854 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:20.744066 18854 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6fb0440d4254fa6aa4007a6421b4263, State: Initialized, Role: FOLLOWER
I20260811 04:48:20.744567 18854 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } }
I20260811 04:48:20.744732 18854 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:20.744818 18854 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:20.744917 18854 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:20.745977 18854 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } }
I20260811 04:48:20.746330 18854 leader_election.cc:302] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6fb0440d4254fa6aa4007a6421b4263; no voters:
I20260811 04:48:20.746649 18854 leader_election.cc:288] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:20.746810 18860 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:20.747074 18860 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [term 1 LEADER]: Becoming Leader. State: Replica: c6fb0440d4254fa6aa4007a6421b4263, State: Running, Role: LEADER
I20260811 04:48:20.747429 18860 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } }
I20260811 04:48:20.747898 18854 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:20.749225 18862 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6fb0440d4254fa6aa4007a6421b4263. Latest consensus state: current_term: 1 leader_uuid: "c6fb0440d4254fa6aa4007a6421b4263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } } }
I20260811 04:48:20.749387 18862 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:20.749225 18861 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6fb0440d4254fa6aa4007a6421b4263" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6fb0440d4254fa6aa4007a6421b4263" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 33621 } } }
I20260811 04:48:20.749738 18861 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:20.749879 18872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:20.752991 18872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:20.758386 18872 catalog_manager.cc:1347] Generated new cluster ID: d27b14995d5546e88014e77656abc6ba
I20260811 04:48:20.758460 18872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:20.784482 18872 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:20.785517 18872 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:20.789307 18872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6fb0440d4254fa6aa4007a6421b4263: Generated new TSK 0
I20260811 04:48:20.790007 18872 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:20.820927 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:20.945950 18886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:20.946183 18886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:20.946255 18886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:20.950830 18886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:20.950886 18886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:20.950973 18886 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:20.956248 18886 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:20.957247 18886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:20.958338 18886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:20.967768 18894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:20.967744 18891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:20.968024 18886 server_base.cc:1034] running on GCE node
W20260811 04:48:20.968063 18892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:20.968549 18886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:20.969210 18886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:20.970403 18886 hybrid_clock.cc:648] HybridClock initialized: now 1786423700970389 us; error 23 us; skew 500 ppm
Aug 11 04:48:20 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:20.973161 18886 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:20.974040 18886 webserver.cc:460] Webserver started at http://127.17.188.65:39435/ using document root <none> and password file <none>
I20260811 04:48:20.974625 18886 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:20.974814 18886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:20.975087 18886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:20.977094 18886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "85a6a5ffa2614ef897eb3e4da2a9b174"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "896474461a1dba9e5c2b4cf649c89e9c"
server_key_iv: "d86d771eaadf011d8b2287efbbf12f9f"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.977713 18886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "85a6a5ffa2614ef897eb3e4da2a9b174"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "896474461a1dba9e5c2b4cf649c89e9c"
server_key_iv: "d86d771eaadf011d8b2287efbbf12f9f"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.981232 18886 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:48:20.983583 18901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:20.984745 18886 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:20.984874 18886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "85a6a5ffa2614ef897eb3e4da2a9b174"
format_stamp: "Formatted at 2026-08-11 04:48:20 on dist-test-slave-njxd"
server_key: "896474461a1dba9e5c2b4cf649c89e9c"
server_key_iv: "d86d771eaadf011d8b2287efbbf12f9f"
server_key_version: "encryptionkey@0"
I20260811 04:48:20.984973 18886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:21.005750 18886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:21.008528 18886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:21.008720 18886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:21.009274 18886 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:21.010149 18886 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:21.010216 18886 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.010283 18886 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:21.010329 18886 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.018761 18886 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:40421
I20260811 04:48:21.018810 19031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:40421 every 8 connection(s)
I20260811 04:48:21.019605 18886 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:21.028600 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 18886
I20260811 04:48:21.028714 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:21.028975 18161 external_mini_cluster.cc:1428] Setting key a34e5e6c303790b4760166dc63e2b4b6
I20260811 04:48:21.032603 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.021233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:48987 (local address 127.17.188.126:33621)
0811 04:48:21.021364 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.021367 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.022182 (+ 815us) server_negotiation.cc:407] Connection header received
0811 04:48:21.022998 (+ 816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.023001 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.023047 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.023124 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.024231 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.024757 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.025906 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.026158 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.026238 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.028582 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.028585 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.028587 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.028612 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.030365 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.030939 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.030941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.030943 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.031019 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.031423 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.031425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.031427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.031627 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.031702 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.032290 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.032385 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:21.033394 19034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.021519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:33621 (local address 127.17.188.65:48987)
0811 04:48:21.022027 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.022065 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.022778 (+ 713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.023286 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.023293 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.023657 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:21.024099 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.024114 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.024858 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.024861 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.025801 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.025811 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.026282 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.026284 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.026416 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.026982 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:21.026999 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:21.028416 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:21.030489 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.030494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.030508 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.030831 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.031122 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.031127 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.031131 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.031310 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.031739 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:21.031748 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:21.032022 (+ 274us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.032254 (+ 232us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.032584 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":123,"threads_started":1}
I20260811 04:48:21.034649 19032 heartbeater.cc:347] Connected to a master server at 127.17.188.126:33621
I20260811 04:48:21.034870 19032 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:21.035305 19032 heartbeater.cc:511] Master 127.17.188.126:33621 requested a full tablet report, sending...
I20260811 04:48:21.036942 18814 ts_manager.cc:194] Registered new tserver with Master: 85a6a5ffa2614ef897eb3e4da2a9b174 (127.17.188.65:40421)
I20260811 04:48:21.038658 18814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:48987
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:21.058512 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:21.170513 19037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:21.170765 19037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:21.170833 19037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:21.174786 19037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:21.174868 19037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:21.174960 19037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:21.179889 19037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19037
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:21.180853 19037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:21.181878 19037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:21.190833 19042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:21.190866 19043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:21.190876 19045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:21.191150 19037 server_base.cc:1034] running on GCE node
I20260811 04:48:21.191537 19037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:21.192119 19037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:21.193306 19037 hybrid_clock.cc:648] HybridClock initialized: now 1786423701193284 us; error 27 us; skew 500 ppm
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:21.196033 19037 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:21.196918 19037 webserver.cc:460] Webserver started at http://127.17.188.66:34121/ using document root <none> and password file <none>
I20260811 04:48:21.197486 19037 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:21.197547 19037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:21.197784 19037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:21.199703 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "de5055abef924442962d441732de86fa"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "9be231da2d30236ef0ccb18e72f1f1c2"
server_key_iv: "b4263eff8a3585c153aee2de10b2fe5f"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.200249 19037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "de5055abef924442962d441732de86fa"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "9be231da2d30236ef0ccb18e72f1f1c2"
server_key_iv: "b4263eff8a3585c153aee2de10b2fe5f"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.203707 19037 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:48:21.206501 19052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.207721 19037 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:21.207847 19037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "de5055abef924442962d441732de86fa"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "9be231da2d30236ef0ccb18e72f1f1c2"
server_key_iv: "b4263eff8a3585c153aee2de10b2fe5f"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.207949 19037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:21.239127 19037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:21.242044 19037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:21.242264 19037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:21.242823 19037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:21.243656 19037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:21.243727 19037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.243799 19037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:21.243853 19037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.253258 19037 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:34069
I20260811 04:48:21.253280 19177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:34069 every 8 connection(s)
I20260811 04:48:21.254279 19037 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:21.254791 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19037
I20260811 04:48:21.254896 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:21.255205 18161 external_mini_cluster.cc:1428] Setting key b1c81bf0071a0944dae69ba458dbdbe8
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:21.268085 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.256114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:39603 (local address 127.17.188.126:33621)
0811 04:48:21.256255 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.256260 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.257210 (+ 950us) server_negotiation.cc:407] Connection header received
0811 04:48:21.258168 (+ 958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.258171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.258223 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.258329 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.259491 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.260019 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.261169 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.261406 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.261521 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.264258 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.264261 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.264263 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.264286 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.265809 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.266397 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.266403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.266408 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.266501 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.266860 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.266864 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.266866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.267050 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.267167 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.267734 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.267864 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:48:21.268827 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.256571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:33621 (local address 127.17.188.66:39603)
0811 04:48:21.257071 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.257114 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.257960 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.258498 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.258505 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.258850 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:21.259347 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.259361 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.260156 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.260165 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.261035 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.261045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.261561 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.261565 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.261772 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.262403 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:21.262418 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:21.264078 (+ 1660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:21.265931 (+ 1853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.265937 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.265951 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.266218 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.266610 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.266616 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.266620 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.266762 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.267164 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:21.267171 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:21.267449 (+ 278us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.267692 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.268012 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":141,"threads_started":1}
I20260811 04:48:21.270128 19178 heartbeater.cc:347] Connected to a master server at 127.17.188.126:33621
I20260811 04:48:21.270404 19178 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:21.270977 19178 heartbeater.cc:511] Master 127.17.188.126:33621 requested a full tablet report, sending...
I20260811 04:48:21.272105 18814 ts_manager.cc:194] Registered new tserver with Master: de5055abef924442962d441732de86fa (127.17.188.66:34069)
I20260811 04:48:21.272719 18814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:39603
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:21.284255 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:21.414765 19183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:21.415079 19183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:21.415155 19183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:21.419397 19183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:21.419482 19183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:21.419574 19183 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:21.425045 19183 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:33621
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:21.426186 19183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:21.427249 19183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:21.437546 19192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:21.437506 19188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:21.438201 19183 server_base.cc:1034] running on GCE node
W20260811 04:48:21.438699 19189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:21.439106 19183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:21.439764 19183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:21.440960 19183 hybrid_clock.cc:648] HybridClock initialized: now 1786423701440947 us; error 25 us; skew 500 ppm
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:21.444320 19183 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:21.445263 19183 webserver.cc:460] Webserver started at http://127.17.188.67:43121/ using document root <none> and password file <none>
I20260811 04:48:21.445885 19183 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:21.445982 19183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:21.446218 19183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:21.448602 19183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "a1c5b6a3a4be4def843773e03355339f"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "48067960214f47a2726d25ec481f8c34"
server_key_iv: "19bcce5a7ed101a0116fd93ae19df7f5"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.449285 19183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "a1c5b6a3a4be4def843773e03355339f"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "48067960214f47a2726d25ec481f8c34"
server_key_iv: "19bcce5a7ed101a0116fd93ae19df7f5"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.453377 19183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:48:21.455902 19200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.457154 19183 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:21.457283 19183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "a1c5b6a3a4be4def843773e03355339f"
format_stamp: "Formatted at 2026-08-11 04:48:21 on dist-test-slave-njxd"
server_key: "48067960214f47a2726d25ec481f8c34"
server_key_iv: "19bcce5a7ed101a0116fd93ae19df7f5"
server_key_version: "encryptionkey@0"
I20260811 04:48:21.457391 19183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:21.480876 19183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:21.484936 19183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:21.485226 19183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:21.486147 19183 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:21.487188 19183 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:21.487267 19183 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.487344 19183 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:21.487397 19183 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:21.499284 19183 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44825
I20260811 04:48:21.499323 19329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44825 every 8 connection(s)
I20260811 04:48:21.500339 19183 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:21.501037 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19183
I20260811 04:48:21.501171 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:21.501456 18161 external_mini_cluster.cc:1428] Setting key 622c534a0b656d8858470fc66235a61e
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:21.514509 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.502234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:32863 (local address 127.17.188.126:33621)
0811 04:48:21.502381 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.502388 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.503536 (+ 1148us) server_negotiation.cc:407] Connection header received
0811 04:48:21.504637 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.504640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.504698 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.504810 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.506162 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.506721 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.508014 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.508261 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.508379 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.511033 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.511037 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.511039 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.511069 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.512393 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.512920 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.512928 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.512930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.513007 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.513366 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.513370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.513372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.513562 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.513730 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.514213 (+ 483us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.514339 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 04:48:21.515504 19333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.502731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:33621 (local address 127.17.188.67:32863)
0811 04:48:21.503372 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.503432 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.504406 (+ 974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.505010 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.505017 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.505407 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:21.506001 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.506015 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.506852 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.506855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.507858 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.507869 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.508413 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.508418 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.508635 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.509163 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:21.509180 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:21.510854 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:21.512515 (+ 1661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.512522 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.512536 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.512804 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.513101 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:21.513105 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:21.513107 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:21.513253 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:21.513726 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:21.513732 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:21.513972 (+ 240us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.514168 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.514481 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":152,"threads_started":1}
I20260811 04:48:21.516640 19330 heartbeater.cc:347] Connected to a master server at 127.17.188.126:33621
I20260811 04:48:21.516875 19330 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:21.517344 19330 heartbeater.cc:511] Master 127.17.188.126:33621 requested a full tablet report, sending...
I20260811 04:48:21.518414 18814 ts_manager.cc:194] Registered new tserver with Master: a1c5b6a3a4be4def843773e03355339f (127.17.188.67:44825)
I20260811 04:48:21.518961 18814 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:32863
I20260811 04:48:21.527370 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:48:21.538919 18858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.531345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56136 (local address 127.17.188.126:33621)
0811 04:48:21.531495 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.531500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.531708 (+ 208us) server_negotiation.cc:407] Connection header received
0811 04:48:21.531799 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.531802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.531844 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.531914 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.532599 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.533152 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.534024 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.534265 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.534351 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.535652 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.535655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.535657 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.535681 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.537237 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.537686 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.537689 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.537690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.537768 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.538020 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.538023 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.538024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.538263 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.538372 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.538569 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.538672 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:21.543988 18814 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:21.547314 18814 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:21.562750 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53486 (local address 127.17.188.67:44825)
0811 04:48:21.556814 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.556847 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.556924 (+ 77us) server_negotiation.cc:407] Connection header received
0811 04:48:21.557168 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.557176 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.557398 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.557931 (+ 533us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.558106 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559317 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.561057 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.561938 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.562066 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.562231 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.562430 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.562585 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":91,"threads_started":1}
I20260811 04:48:21.562811 19343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40421 (local address 127.0.0.1:59538)
0811 04:48:21.557295 (+ 1219us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.557309 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.557401 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.557967 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.557970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.557988 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.558114 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.558121 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559695 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.559697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.560834 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.560844 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.561978 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.561981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.562208 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.562265 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.562383 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.562571 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"mutex_wait_us":126,"thread_start_us":115,"threads_started":1}
I20260811 04:48:21.562811 19342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44825 (local address 127.0.0.1:53486)
0811 04:48:21.556796 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.556845 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.556973 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.557601 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.557607 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.557631 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.557768 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.557774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559463 (+ 1689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.559466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.560931 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.560937 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.562057 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.562061 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.562164 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.562293 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.562383 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.562583 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"mutex_wait_us":222,"thread_start_us":75,"threads_started":1}
I20260811 04:48:21.563174 19348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56732 (local address 127.17.188.66:34069)
0811 04:48:21.557760 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.557773 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.557795 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:48:21.557873 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.557880 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.558073 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.558243 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.558465 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559183 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.561057 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.562001 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.562321 (+ 320us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.562477 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.562920 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.563023 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":750,"thread_start_us":134,"threads_started":1}
I20260811 04:48:21.563221 19346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:34069 (local address 127.0.0.1:56732)
0811 04:48:21.557377 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.557391 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.557478 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.558230 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.558233 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.558251 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.558345 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.558351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559313 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.559319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.560908 (+ 1589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.560919 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.562132 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.562136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.562489 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.562684 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.562756 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.562817 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":292,"thread_start_us":207,"threads_started":1}
I20260811 04:48:21.564334 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.556304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59538 (local address 127.17.188.65:40421)
0811 04:48:21.557163 (+ 859us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.557169 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.557511 (+ 342us) server_negotiation.cc:407] Connection header received
0811 04:48:21.557636 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.557642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.557850 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.557994 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.558499 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.559569 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.560966 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.561615 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.561750 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.561905 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.564097 (+ 2192us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.564204 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":713,"thread_start_us":110,"threads_started":1}
I20260811 04:48:21.566013 19255 tablet_service.cc:1467] Processing CreateTablet for tablet d66fc810b9df42acb526b62cb9d9cc8b (DEFAULT_TABLE table=test-table [id=fda1b5c53689419a801d63d3d9a17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:21.566092 19106 tablet_service.cc:1467] Processing CreateTablet for tablet d66fc810b9df42acb526b62cb9d9cc8b (DEFAULT_TABLE table=test-table [id=fda1b5c53689419a801d63d3d9a17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:21.567039 19255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66fc810b9df42acb526b62cb9d9cc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:21.566753 18958 tablet_service.cc:1467] Processing CreateTablet for tablet d66fc810b9df42acb526b62cb9d9cc8b (DEFAULT_TABLE table=test-table [id=fda1b5c53689419a801d63d3d9a17930]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:21.567157 19106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66fc810b9df42acb526b62cb9d9cc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:21.567658 18958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d66fc810b9df42acb526b62cb9d9cc8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:21.573088 19350 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: Bootstrap starting.
I20260811 04:48:21.574518 19351 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: Bootstrap starting.
I20260811 04:48:21.575429 19352 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: Bootstrap starting.
I20260811 04:48:21.575523 19350 tablet_bootstrap.cc:654] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:21.576802 19351 tablet_bootstrap.cc:654] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:21.576858 19350 log.cc:824] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:21.577723 19352 tablet_bootstrap.cc:654] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:21.577703 19351 log.cc:824] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:21.578467 19352 log.cc:824] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:21.579269 19350 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: No bootstrap required, opened a new log
I20260811 04:48:21.579463 19350 ts_tablet_manager.cc:1397] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 04:48:21.579535 19351 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: No bootstrap required, opened a new log
I20260811 04:48:21.579717 19351 ts_tablet_manager.cc:1397] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 04:48:21.580183 19352 tablet_bootstrap.cc:492] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: No bootstrap required, opened a new log
I20260811 04:48:21.580368 19352 ts_tablet_manager.cc:1397] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 04:48:21.583168 19352 raft_consensus.cc:348] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.583413 19352 raft_consensus.cc:374] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:21.583488 19352 raft_consensus.cc:729] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de5055abef924442962d441732de86fa, State: Initialized, Role: FOLLOWER
I20260811 04:48:21.583470 19350 raft_consensus.cc:348] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.583730 19350 raft_consensus.cc:374] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:21.583797 19350 raft_consensus.cc:729] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1c5b6a3a4be4def843773e03355339f, State: Initialized, Role: FOLLOWER
I20260811 04:48:21.583976 19352 consensus_queue.cc:260] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.584120 19351 raft_consensus.cc:348] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.584218 19350 consensus_queue.cc:260] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.584421 19351 raft_consensus.cc:374] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:21.584527 19351 raft_consensus.cc:729] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85a6a5ffa2614ef897eb3e4da2a9b174, State: Initialized, Role: FOLLOWER
I20260811 04:48:21.584996 19351 consensus_queue.cc:260] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.585108 19352 ts_tablet_manager.cc:1428] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260811 04:48:21.585139 19350 ts_tablet_manager.cc:1428] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:48:21.585175 19178 heartbeater.cc:503] Master 127.17.188.126:33621 was elected leader, sending a full tablet report...
I20260811 04:48:21.585449 19330 heartbeater.cc:503] Master 127.17.188.126:33621 was elected leader, sending a full tablet report...
I20260811 04:48:21.585700 19032 heartbeater.cc:503] Master 127.17.188.126:33621 was elected leader, sending a full tablet report...
I20260811 04:48:21.585929 19351 ts_tablet_manager.cc:1428] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174: Time spent starting tablet: real 0.006s user 0.000s sys 0.007s
I20260811 04:48:21.625474 19356 raft_consensus.cc:482] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:21.625531 19358 raft_consensus.cc:482] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:21.625779 19358 raft_consensus.cc:504] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.625771 19356 raft_consensus.cc:504] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.626906 19356 leader_election.cc:288] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c5b6a3a4be4def843773e03355339f (127.17.188.67:44825), 85a6a5ffa2614ef897eb3e4da2a9b174 (127.17.188.65:40421)
I20260811 04:48:21.626916 19358 leader_election.cc:288] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1c5b6a3a4be4def843773e03355339f (127.17.188.67:44825), de5055abef924442962d441732de86fa (127.17.188.66:34069)
I20260811 04:48:21.631819 19344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:48307 (local address 127.17.188.67:44825)
0811 04:48:21.627457 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.627463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.627480 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:48:21.627537 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.627540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.627589 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.627684 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.628145 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.628925 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.630478 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.631065 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.631176 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.631227 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.631625 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.631696 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 04:48:21.632341 19180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44825 (local address 127.17.188.66:48307)
0811 04:48:21.627283 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.627298 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.627397 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.627814 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.627819 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.627837 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.627966 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.627973 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629063 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.629068 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.630301 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.630313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.631291 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.631295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.631422 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.631467 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.631533 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.632212 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"mutex_wait_us":599}
I20260811 04:48:21.632581 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:45459 (local address 127.17.188.65:40421)
0811 04:48:21.628080 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.628084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.628338 (+ 254us) server_negotiation.cc:407] Connection header received
0811 04:48:21.628542 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.628546 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.628590 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.628645 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.629038 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629807 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.631263 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.631844 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.631938 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.631979 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.632396 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.632466 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":40}
I20260811 04:48:21.632706 19348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:44085 (local address 127.17.188.66:34069)
0811 04:48:21.627866 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.627870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.628199 (+ 329us) server_negotiation.cc:407] Connection header received
0811 04:48:21.628364 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.628367 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.628423 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.628465 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.628949 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629781 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.631433 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.632060 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.632183 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.632260 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.632526 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.632599 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":68,"server-negotiator.queue_time_us":44,"spinlock_wait_cycles":3328}
I20260811 04:48:21.632961 19362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40421 (local address 127.17.188.66:45459)
0811 04:48:21.628266 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.628280 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.628430 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.628775 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.628779 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.628794 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.628921 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.628928 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629976 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.629979 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.631124 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.631134 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.632056 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.632059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.632186 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.632289 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.632741 (+ 452us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.632815 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":5,"spinlock_wait_cycles":37760,"thread_start_us":95,"threads_started":1}
I20260811 04:48:21.632978 19279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "de5055abef924442962d441732de86fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c5b6a3a4be4def843773e03355339f" is_pre_election: true
I20260811 04:48:21.633085 19361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:34069 (local address 127.17.188.65:44085)
0811 04:48:21.628114 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.628130 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.628260 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.628581 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.628583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.628598 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.628828 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.628834 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629969 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.629972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.631310 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.631319 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.632268 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.632272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.632373 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.632402 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.632864 (+ 462us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.632930 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":61,"spinlock_wait_cycles":39808,"thread_start_us":113,"threads_started":1}
I20260811 04:48:21.633286 19279 raft_consensus.cc:2454] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de5055abef924442962d441732de86fa in term 0.
I20260811 04:48:21.633452 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "de5055abef924442962d441732de86fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" is_pre_election: true
I20260811 04:48:21.633658 18979 raft_consensus.cc:2454] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de5055abef924442962d441732de86fa in term 0.
I20260811 04:48:21.633842 19053 leader_election.cc:302] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1c5b6a3a4be4def843773e03355339f, de5055abef924442962d441732de86fa; no voters:
I20260811 04:48:21.634008 19128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de5055abef924442962d441732de86fa" is_pre_election: true
I20260811 04:48:21.634099 19356 raft_consensus.cc:2781] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:21.634228 19128 raft_consensus.cc:2454] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85a6a5ffa2614ef897eb3e4da2a9b174 in term 0.
I20260811 04:48:21.634379 19356 raft_consensus.cc:482] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:21.634483 19356 raft_consensus.cc:3037] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:21.634538 19360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:34483 (local address 127.17.188.67:44825)
0811 04:48:21.627602 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.627613 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.628072 (+ 459us) server_negotiation.cc:407] Connection header received
0811 04:48:21.628332 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.628335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.628384 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.628450 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:21.628934 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629821 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.632228 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.632882 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.632975 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.633031 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.634310 (+ 1279us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.634385 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":292,"thread_start_us":119,"threads_started":1}
I20260811 04:48:21.634671 18903 leader_election.cc:302] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85a6a5ffa2614ef897eb3e4da2a9b174, de5055abef924442962d441732de86fa; no voters:
I20260811 04:48:21.634938 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.627098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44825 (local address 127.17.188.65:34483)
0811 04:48:21.627985 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:21.628000 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:21.628151 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:21.628608 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:21.628614 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:21.628643 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:21.628809 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.628816 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.629998 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.630003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.632098 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:21.632106 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.633138 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.633141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:21.634150 (+ 1009us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.634172 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:48:21.634685 (+ 513us) client_negotiation.cc:240] Negotiation successful
0811 04:48:21.634764 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":2,"spinlock_wait_cycles":15616,"thread_start_us":136,"threads_started":1}
I20260811 04:48:21.634938 19358 raft_consensus.cc:2781] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:21.635066 19358 raft_consensus.cc:482] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:21.635128 19358 raft_consensus.cc:3037] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:21.635475 19279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c5b6a3a4be4def843773e03355339f" is_pre_election: true
I20260811 04:48:21.635607 19279 raft_consensus.cc:2454] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85a6a5ffa2614ef897eb3e4da2a9b174 in term 0.
I20260811 04:48:21.635923 19356 raft_consensus.cc:504] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.636299 19356 leader_election.cc:288] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [CANDIDATE]: Term 1 election: Requested vote from peers a1c5b6a3a4be4def843773e03355339f (127.17.188.67:44825), 85a6a5ffa2614ef897eb3e4da2a9b174 (127.17.188.65:40421)
I20260811 04:48:21.636468 19358 raft_consensus.cc:504] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.636622 19279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "de5055abef924442962d441732de86fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c5b6a3a4be4def843773e03355339f"
I20260811 04:48:21.636662 18979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "de5055abef924442962d441732de86fa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174"
I20260811 04:48:21.636746 19279 raft_consensus.cc:3037] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:21.636817 18979 raft_consensus.cc:2379] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate de5055abef924442962d441732de86fa in current term 1: Already voted for candidate 85a6a5ffa2614ef897eb3e4da2a9b174 in this term.
I20260811 04:48:21.636857 19358 leader_election.cc:288] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [CANDIDATE]: Term 1 election: Requested vote from peers a1c5b6a3a4be4def843773e03355339f (127.17.188.67:44825), de5055abef924442962d441732de86fa (127.17.188.66:34069)
I20260811 04:48:21.637180 19278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1c5b6a3a4be4def843773e03355339f"
I20260811 04:48:21.637398 19128 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d66fc810b9df42acb526b62cb9d9cc8b" candidate_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de5055abef924442962d441732de86fa"
I20260811 04:48:21.637542 19128 raft_consensus.cc:2379] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 85a6a5ffa2614ef897eb3e4da2a9b174 in current term 1: Already voted for candidate de5055abef924442962d441732de86fa in this term.
I20260811 04:48:21.637934 18903 leader_election.cc:302] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 85a6a5ffa2614ef897eb3e4da2a9b174; no voters: a1c5b6a3a4be4def843773e03355339f, de5055abef924442962d441732de86fa
I20260811 04:48:21.638095 19358 raft_consensus.cc:2726] T d66fc810b9df42acb526b62cb9d9cc8b P 85a6a5ffa2614ef897eb3e4da2a9b174 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 04:48:21.638134 19279 raft_consensus.cc:2454] T d66fc810b9df42acb526b62cb9d9cc8b P a1c5b6a3a4be4def843773e03355339f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de5055abef924442962d441732de86fa in term 1.
I20260811 04:48:21.638432 19053 leader_election.cc:302] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1c5b6a3a4be4def843773e03355339f, de5055abef924442962d441732de86fa; no voters: 85a6a5ffa2614ef897eb3e4da2a9b174
I20260811 04:48:21.638592 19356 raft_consensus.cc:2781] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:21.638826 19356 raft_consensus.cc:686] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [term 1 LEADER]: Becoming Leader. State: Replica: de5055abef924442962d441732de86fa, State: Running, Role: LEADER
I20260811 04:48:21.639143 19356 consensus_queue.cc:237] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } }
I20260811 04:48:21.642568 18811 catalog_manager.cc:5495] T d66fc810b9df42acb526b62cb9d9cc8b P de5055abef924442962d441732de86fa reported cstate change: term changed from 0 to 1, leader changed from <none> to de5055abef924442962d441732de86fa (127.17.188.66). New cstate: current_term: 1 leader_uuid: "de5055abef924442962d441732de86fa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1c5b6a3a4be4def843773e03355339f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85a6a5ffa2614ef897eb3e4da2a9b174" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de5055abef924442962d441732de86fa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 34069 } health_report { overall_health: HEALTHY } } }
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423700, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:21.660787 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.652137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59542 (local address 127.17.188.65:40421)
0811 04:48:21.652264 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.652267 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.652281 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:21.652355 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.652358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.652397 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.652469 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.653184 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.653753 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.654571 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.654799 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.654878 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.657360 (+ 2482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.657373 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.657388 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.657412 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.658996 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.659466 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.659472 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.659473 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.659552 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.659852 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.659856 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.659858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.660104 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.660331 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.660485 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.660623 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:21.687914 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.680426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59558 (local address 127.17.188.65:40421)
0811 04:48:21.680608 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.680612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.680699 (+ 87us) server_negotiation.cc:407] Connection header received
0811 04:48:21.680809 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.680812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.680852 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.680925 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.681555 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.682128 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.682887 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.683086 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.683155 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.685349 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.685352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.685354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.685375 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.686521 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.686926 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.686929 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.686930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.686994 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.687209 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.687210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.687211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.687356 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.687463 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.687667 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.687754 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[18763](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:21.713737 19345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:21.705327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59566 (local address 127.17.188.65:40421)
0811 04:48:21.705511 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:21.705516 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:21.705719 (+ 203us) server_negotiation.cc:407] Connection header received
0811 04:48:21.705886 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:21.705889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:21.705930 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:21.706010 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:21.706688 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.707171 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.707988 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:21.708191 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:21.708292 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:21.710916 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:21.710919 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:21.710921 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:21.710943 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:21.712259 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.712659 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.712661 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.712662 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.712733 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:21.712972 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:21.712974 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:21.712975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:21.713123 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:21.713268 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:21.713424 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 04:48:21.713516 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 04:48:21.715224 18935 tablet_service.cc:2908] Rejecting scan request for tablet d66fc810b9df42acb526b62cb9d9cc8b: Uninitialized: clean time has not yet been initialized
I20260811 04:48:21.717684 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18886
I20260811 04:48:21.727144 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19037
I20260811 04:48:21.735760 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19183
I20260811 04:48:21.744017 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 18779
2026-08-11T04:48:21Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2420 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[19380](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[19380](info): set up 2 sockets
Aug 11 04:48:21 dist-test-slave-njxd krb5kdc[19380](info): commencing operation
krb5kdc: starting...
W20260811 04:48:22.832554 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:22 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:22.954370 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34405
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:23.064832 19395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:23.065137 19395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:23.065215 19395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:23.069186 19395 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:23.069283 19395 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 04:48:23.069314 19395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:23.069377 19395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:23.069437 19395 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:23.069489 19395 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:23.078213 19395 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34405
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19395
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:23.079337 19395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:23.080413 19395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:23.088974 19407 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.088989 19404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.088949 19403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:23.089258 19395 server_base.cc:1034] running on GCE node
I20260811 04:48:23.089969 19395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:23.091051 19395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:23.092247 19395 hybrid_clock.cc:648] HybridClock initialized: now 1786423703092228 us; error 31 us; skew 500 ppm
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:23.095109 19395 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:23.095973 19395 webserver.cc:460] Webserver started at http://127.17.188.126:33923/ using document root <none> and password file <none>
I20260811 04:48:23.096491 19395 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:23.096547 19395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:23.096711 19395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:23.098788 19395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "1952eb454d7a4e9587ff9a7dd427175f"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "8b7dfce876199cb3a8d0b607de313685"
server_key_iv: "8801cc97e40b80038740951602295b96"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.099311 19395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "1952eb454d7a4e9587ff9a7dd427175f"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "8b7dfce876199cb3a8d0b607de313685"
server_key_iv: "8801cc97e40b80038740951602295b96"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.102869 19395 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:23.105108 19414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.106329 19395 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:23.106422 19395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "1952eb454d7a4e9587ff9a7dd427175f"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "8b7dfce876199cb3a8d0b607de313685"
server_key_iv: "8801cc97e40b80038740951602295b96"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.106499 19395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:23.138836 19395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:23.141841 19395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:23.142004 19395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:23.150267 19395 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34405
I20260811 04:48:23.150288 19484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34405 every 8 connection(s)
I20260811 04:48:23.151292 19395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:23.154049 19485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:23.159576 19485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Bootstrap starting.
I20260811 04:48:23.160810 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19395
I20260811 04:48:23.160926 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:23.161175 18161 external_mini_cluster.cc:1428] Setting key a157d6c25c33b69982fa9c2df41b1caf
I20260811 04:48:23.162462 19485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:23.163357 19485 log.cc:824] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:23.165614 19485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: No bootstrap required, opened a new log
I20260811 04:48:23.169829 19485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } }
I20260811 04:48:23.170099 19485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:23.170183 19485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1952eb454d7a4e9587ff9a7dd427175f, State: Initialized, Role: FOLLOWER
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:23.170711 19485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } }
I20260811 04:48:23.170866 19485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:23.170957 19485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:23.171057 19485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:23.172279 19485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } }
I20260811 04:48:23.172663 19485 leader_election.cc:302] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1952eb454d7a4e9587ff9a7dd427175f; no voters:
I20260811 04:48:23.173022 19485 leader_election.cc:288] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:23.173209 19491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:23.173460 19491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [term 1 LEADER]: Becoming Leader. State: Replica: 1952eb454d7a4e9587ff9a7dd427175f, State: Running, Role: LEADER
I20260811 04:48:23.173849 19491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } }
I20260811 04:48:23.174476 19485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:23.175729 19492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1952eb454d7a4e9587ff9a7dd427175f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } } }
I20260811 04:48:23.175858 19492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:23.176971 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.162279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37954 (local address 127.17.188.126:34405)
0811 04:48:23.162805 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.162823 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.162864 (+ 41us) server_negotiation.cc:407] Connection header received
0811 04:48:23.163706 (+ 842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.163733 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.164070 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.164414 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.165118 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.166509 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.167354 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.168068 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.168258 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.171206 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.171216 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.171232 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.171267 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.173237 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.173818 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.173823 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.173830 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.173984 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.174328 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.174331 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.174333 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.174874 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.175084 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.175450 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.175812 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":135,"threads_started":1}
I20260811 04:48:23.176234 19493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1952eb454d7a4e9587ff9a7dd427175f. Latest consensus state: current_term: 1 leader_uuid: "1952eb454d7a4e9587ff9a7dd427175f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1952eb454d7a4e9587ff9a7dd427175f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34405 } } }
I20260811 04:48:23.177841 19493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f [sys.catalog]: This master's current role is: LEADER
W20260811 04:48:23.179713 19506 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:48:23.179803 19506 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:48:23.179881 19500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:23.180543 19500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:23.185942 19500 catalog_manager.cc:1347] Generated new cluster ID: 6bc3902d7c4a4ebb8e0f4b86948c31d4
I20260811 04:48:23.186002 19500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:23.214568 19500 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:23.215883 19500 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:23.223359 19500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Generated new TSK 0
I20260811 04:48:23.224177 19500 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:23.257091 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34405
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:23.369182 19513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:23.369501 19513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:23.369608 19513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:23.373438 19513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:23.373521 19513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:23.373638 19513 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:23.373718 19513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:23.379050 19513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:34405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:23.380046 19513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:23.381019 19513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:23.390302 19513 server_base.cc:1034] running on GCE node
W20260811 04:48:23.390278 19518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.390357 19521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.390275 19519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:23.390849 19513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:23.391448 19513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:23.392633 19513 hybrid_clock.cc:648] HybridClock initialized: now 1786423703392614 us; error 29 us; skew 500 ppm
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:23.395476 19513 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:23.396346 19513 webserver.cc:460] Webserver started at http://127.17.188.65:44057/ using document root <none> and password file <none>
I20260811 04:48:23.396889 19513 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:23.396981 19513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:23.397222 19513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:23.399272 19513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "57b65c45ec40531c9518c4f031ca0955"
server_key_iv: "745a9ae15a1cff66e60c835a0e907243"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.399814 19513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "57b65c45ec40531c9518c4f031ca0955"
server_key_iv: "745a9ae15a1cff66e60c835a0e907243"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.403317 19513 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:48:23.405679 19529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.406836 19513 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:23.406976 19513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "57b65c45ec40531c9518c4f031ca0955"
server_key_iv: "745a9ae15a1cff66e60c835a0e907243"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.407088 19513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:23.423620 19513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:23.427093 19513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:23.427309 19513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:23.428869 19513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:23.428946 19513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.429024 19513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:23.429081 19513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:23.440219 19513 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37183
I20260811 04:48:23.440267 19661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37183 every 8 connection(s)
I20260811 04:48:23.441143 19513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:23.444391 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19513
I20260811 04:48:23.444425 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.429694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:38701 (local address 127.17.188.126:34405)
0811 04:48:23.429822 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.429826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.431435 (+ 1609us) server_negotiation.cc:407] Connection header received
0811 04:48:23.432643 (+ 1208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.432647 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.432736 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.432835 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.434626 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.435349 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.437168 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.437397 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.437482 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.440632 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.440635 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.440637 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.440662 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.442359 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.443004 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.443007 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.443008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.443103 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.443409 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.443411 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.443412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.443602 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.443675 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.444182 (+ 507us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.444300 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:48:23.444514 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:23.444792 18161 external_mini_cluster.cc:1428] Setting key 7d9c766fc66a7936bf32eeda1be0237f
I20260811 04:48:23.445464 19538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.430770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.65:38701)
0811 04:48:23.431278 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.431320 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.432399 (+ 1079us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.433041 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.433053 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.433658 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.434407 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.434431 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.435489 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.435494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.437034 (+ 1540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.437045 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.437601 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.437610 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.437837 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.438538 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.438574 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.440423 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.442520 (+ 2097us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.442527 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.442544 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.442902 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.443184 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.443186 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.443188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.443320 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.443687 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.443692 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.443914 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.444061 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.444420 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":143,"threads_started":1}
I20260811 04:48:23.446903 19662 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34405
I20260811 04:48:23.447077 19662 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:23.447671 19662 heartbeater.cc:511] Master 127.17.188.126:34405 requested a full tablet report, sending...
I20260811 04:48:23.449755 19434 ts_manager.cc:194] Registered new tserver with Master: e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183)
I20260811 04:48:23.451278 19434 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:38701
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:23.457319 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.449382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:33595 (local address 127.17.188.126:34405)
0811 04:48:23.449504 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.449512 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.449592 (+ 80us) server_negotiation.cc:407] Connection header received
0811 04:48:23.449778 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.449782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.449840 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.449926 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.450623 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.451383 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.452538 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.452767 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.452874 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.454095 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.454099 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.454102 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.454133 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.455610 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.456076 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.456079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.456080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.456161 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.456450 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.456455 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.456456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.456632 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.456742 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.457030 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.457149 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":45}
I20260811 04:48:23.457327 19669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.449031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.65:33595)
0811 04:48:23.449473 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.449489 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.449685 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.450077 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.450083 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.450315 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.450473 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.450484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.451535 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.451539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.452409 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.452418 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.452892 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.452895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.452992 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.453535 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.453547 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.453957 (+ 410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.455726 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.455731 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.455733 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.455938 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.456263 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.456266 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.456269 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.456358 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.456733 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.456736 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.456865 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.456976 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.457128 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":2,"thread_start_us":119,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:23.474808 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34405
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:23.587692 19671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:23.587926 19671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:23.588014 19671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:23.592010 19671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:23.592067 19671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:23.592146 19671 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:23.592234 19671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:23.597404 19671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:34405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:23.598482 19671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:23.599501 19671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:23.609122 19676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.609151 19679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.609098 19677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:23.609566 19671 server_base.cc:1034] running on GCE node
I20260811 04:48:23.610095 19671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:23.610834 19671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:23.612007 19671 hybrid_clock.cc:648] HybridClock initialized: now 1786423703611976 us; error 43 us; skew 500 ppm
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:23.614857 19671 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:23.615728 19671 webserver.cc:460] Webserver started at http://127.17.188.66:40097/ using document root <none> and password file <none>
I20260811 04:48:23.616292 19671 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:23.616384 19671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:23.616631 19671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:23.618780 19671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "3016260309b04160a8aedfcce15f0b41"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "4e46ab857e07a1096c77466e8eb370aa"
server_key_iv: "7e27e9800d50cf16f1f72656841c8adf"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.619346 19671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "3016260309b04160a8aedfcce15f0b41"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "4e46ab857e07a1096c77466e8eb370aa"
server_key_iv: "7e27e9800d50cf16f1f72656841c8adf"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.623154 19671 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:23.625506 19686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.626780 19671 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:23.626914 19671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "3016260309b04160a8aedfcce15f0b41"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "4e46ab857e07a1096c77466e8eb370aa"
server_key_iv: "7e27e9800d50cf16f1f72656841c8adf"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.627022 19671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:23.645936 19671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:23.649068 19671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:23.649283 19671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:23.650983 19671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:23.651057 19671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.651126 19671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:23.651160 19671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:23.662442 19671 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:44079
I20260811 04:48:23.662523 19816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:44079 every 8 connection(s)
I20260811 04:48:23.663367 19671 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:23.665642 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.651961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:41343 (local address 127.17.188.126:34405)
0811 04:48:23.652100 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.652104 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.653163 (+ 1059us) server_negotiation.cc:407] Connection header received
0811 04:48:23.654353 (+ 1190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.654357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.654424 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.654541 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.656262 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.657152 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.658683 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.658921 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.659044 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.661798 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.661801 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.661804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.661830 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.663447 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.664059 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.664062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.664064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.664161 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.664510 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.664513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.664515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.664712 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.664821 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.665306 (+ 485us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.665431 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:23.666392 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.652499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.66:41343)
0811 04:48:23.653002 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.653044 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.654084 (+ 1040us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.654791 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.654802 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.655318 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.656058 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.656082 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.657318 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.657321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.658553 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.658563 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.659104 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.659108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.659284 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.659937 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.659953 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.661527 (+ 1574us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.663567 (+ 2040us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.663573 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.663612 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.663935 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.664260 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.664263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.664266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.664403 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.664818 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.664825 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.665054 (+ 229us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.665241 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.665549 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":143,"threads_started":1}
I20260811 04:48:23.667579 19817 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34405
I20260811 04:48:23.667742 19817 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:23.668259 19817 heartbeater.cc:511] Master 127.17.188.126:34405 requested a full tablet report, sending...
I20260811 04:48:23.669320 19435 ts_manager.cc:194] Registered new tserver with Master: 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079)
I20260811 04:48:23.670116 19435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:41343
I20260811 04:48:23.671955 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19671
I20260811 04:48:23.672082 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:23.672369 18161 external_mini_cluster.cc:1428] Setting key 646c81af542d8b23465d6c44a4995a80
I20260811 04:48:23.678848 19823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.669806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.66:56935)
0811 04:48:23.670073 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.670089 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.670205 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.670710 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.670712 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.670870 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.670965 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.670970 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.671709 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.671714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.672543 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.672554 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.673139 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.673143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.673244 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.673796 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.673819 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.674297 (+ 478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.676373 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.676376 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.676377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.676568 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.677708 (+ 1140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.677710 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.677711 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.677795 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.678357 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.678360 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.678450 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.678575 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.678702 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":104,"threads_started":1}
I20260811 04:48:23.679031 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.669866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:56935 (local address 127.17.188.126:34405)
0811 04:48:23.669995 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.669999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.670172 (+ 173us) server_negotiation.cc:407] Connection header received
0811 04:48:23.670299 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.670302 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.670350 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.670447 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.671080 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.671583 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.672694 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.673007 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.673113 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.674426 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.674429 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.674431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.674452 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.676262 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.676705 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.676710 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.676713 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.677565 (+ 852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.677896 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.677902 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.677906 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.678226 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.678339 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.678644 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.678786 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:23.702122 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34405
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:23.814906 19828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:23.815223 19828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:23.815310 19828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:23.819284 19828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:23.819367 19828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:23.819437 19828 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:23.819517 19828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:23.824596 19828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:34405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:23.825636 19828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:23.826638 19828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:23.836202 19836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.836229 19833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:23.836262 19834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:23.836390 19828 server_base.cc:1034] running on GCE node
I20260811 04:48:23.836807 19828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:23.837369 19828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:23.838533 19828 hybrid_clock.cc:648] HybridClock initialized: now 1786423703838486 us; error 56 us; skew 500 ppm
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:23.841140 19828 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:23.842023 19828 webserver.cc:460] Webserver started at http://127.17.188.67:36951/ using document root <none> and password file <none>
I20260811 04:48:23.842566 19828 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:23.842633 19828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:23.842841 19828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:23.844863 19828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "cfa1d11e55fc4e9da7297ab314257fd8"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "cf6109dc627c57cb74b6b20dd15ec108"
server_key_iv: "0b758a421f0613c96dde41ff860a99ac"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.845450 19828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "cfa1d11e55fc4e9da7297ab314257fd8"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "cf6109dc627c57cb74b6b20dd15ec108"
server_key_iv: "0b758a421f0613c96dde41ff860a99ac"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.849705 19828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 04:48:23.852656 19844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.854157 19828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260811 04:48:23.854322 19828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "cfa1d11e55fc4e9da7297ab314257fd8"
format_stamp: "Formatted at 2026-08-11 04:48:23 on dist-test-slave-njxd"
server_key: "cf6109dc627c57cb74b6b20dd15ec108"
server_key_iv: "0b758a421f0613c96dde41ff860a99ac"
server_key_version: "encryptionkey@0"
I20260811 04:48:23.854453 19828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:23.878089 19828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:23.881122 19828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:23.881333 19828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:23.882815 19828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:23.882891 19828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:23.882961 19828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:23.883014 19828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:23.893883 19828 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:41605
I20260811 04:48:23.893992 19974 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:41605 every 8 connection(s)
I20260811 04:48:23.894990 19828 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:23.897397 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.883796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:57143 (local address 127.17.188.126:34405)
0811 04:48:23.883929 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.883933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.884976 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 04:48:23.886076 (+ 1100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.886080 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.886184 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.886272 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.887846 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.888731 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.890267 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.890500 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.890622 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.893443 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.893446 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.893449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.893472 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.895373 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.895985 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.895988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.895990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.896083 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.896494 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.896496 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.896497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.896691 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.896766 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.897189 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.897283 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:23.898201 19854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.884313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.67:57143)
0811 04:48:23.884818 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.884859 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.885846 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.886511 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.886521 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.886999 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.887667 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.887689 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.888913 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.888917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.890095 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.890125 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.890670 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.890674 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.890832 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.891835 (+ 1003us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.891851 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.893270 (+ 1419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.895500 (+ 2230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.895505 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.895519 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.895876 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.896201 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.896204 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.896206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.896397 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.896781 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.896785 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.896986 (+ 201us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.897143 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.897368 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":145,"threads_started":1}
I20260811 04:48:23.898955 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 19828
I20260811 04:48:23.899081 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:23.899398 18161 external_mini_cluster.cc:1428] Setting key e54b23f648567de15e9c9827fb74eb22
I20260811 04:48:23.899724 19975 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34405
I20260811 04:48:23.899857 19975 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:23.900400 19975 heartbeater.cc:511] Master 127.17.188.126:34405 requested a full tablet report, sending...
I20260811 04:48:23.901454 19435 ts_manager.cc:194] Registered new tserver with Master: cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67:41605)
I20260811 04:48:23.902202 19435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:57143
I20260811 04:48:23.909011 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.902025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:58351 (local address 127.17.188.126:34405)
0811 04:48:23.902126 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.902129 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.902400 (+ 271us) server_negotiation.cc:407] Connection header received
0811 04:48:23.902530 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.902535 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.902578 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.902665 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.903072 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.903552 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.904376 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.904597 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.904704 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.905855 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.905859 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.905861 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.905884 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.907292 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.907746 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.907749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.907751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.907830 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.908156 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.908159 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.908161 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.908355 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.908462 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.908769 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.908877 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 04:48:23.909024 19982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.901968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.17.188.67:58351)
0811 04:48:23.902249 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.902311 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.902416 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.902681 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.902684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.902870 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:23.902960 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.902966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.903698 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.903702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.904252 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.904259 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.904709 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.904713 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.904802 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.905335 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:23.905362 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:23.905717 (+ 355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:23.907405 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.907410 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.907412 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.907632 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.907973 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:23.907975 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:23.907977 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:23.908064 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:23.908454 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:23.908457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:23.908570 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.908714 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.908846 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":114,"threads_started":1}
I20260811 04:48:23.913081 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 04:48:23 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:23.939937 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.931756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37962 (local address 127.17.188.126:34405)
0811 04:48:23.931894 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.931898 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.931912 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:23.931955 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.931957 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.931997 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.932076 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:23.932784 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.933313 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.934198 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.934417 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.934502 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.936780 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:23.936782 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:23.936784 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:23.936807 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:23.938271 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.938704 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.938708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.938710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.938800 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:23.939079 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:23.939083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:23.939085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:23.939264 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:23.939409 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.939646 (+ 237us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.939767 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:48:23.942837 19435 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:23.945827 19435 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:23.961181 19994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.954467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41605 (local address 127.0.0.1:46370)
0811 04:48:23.955739 (+ 1272us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.955793 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.955946 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.957048 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.957053 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.957072 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:23.957154 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.957159 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958520 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.958525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.959587 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.959597 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.960630 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.960634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.960736 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.960789 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.960895 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.961011 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1082,"mutex_wait_us":17,"spinlock_wait_cycles":5504,"thread_start_us":124,"threads_started":1}
I20260811 04:48:23.961480 19996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.954634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37183 (local address 127.0.0.1:57978)
0811 04:48:23.955785 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.955797 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.955946 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.956457 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.956463 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.956486 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:23.956638 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.956646 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958250 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.958253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.959854 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.959863 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.961073 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.961077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.961173 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.961199 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.961272 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.961344 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1100,"mutex_wait_us":42,"spinlock_wait_cycles":5760,"thread_start_us":109,"threads_started":1}
I20260811 04:48:23.961869 19995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.954857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44079 (local address 127.0.0.1:47436)
0811 04:48:23.956195 (+ 1338us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:23.956209 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:23.956289 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:23.956702 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:23.956705 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:23.956724 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:23.956833 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.956840 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958202 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.958207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.959821 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:23.959833 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.961422 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.961425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:23.961520 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.961544 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:23.961651 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 04:48:23.961740 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1281,"mutex_wait_us":183,"thread_start_us":89,"threads_started":1}
I20260811 04:48:23.961889 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.955218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57978 (local address 127.17.188.65:37183)
0811 04:48:23.955550 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.955556 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.955884 (+ 328us) server_negotiation.cc:407] Connection header received
0811 04:48:23.956121 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.956125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.956293 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.956453 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:23.956773 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958133 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.959983 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.960511 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.960860 (+ 349us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.961013 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.961652 (+ 639us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.961767 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":125,"threads_started":1}
I20260811 04:48:23.962002 19999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.955218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.17.188.67:41605)
0811 04:48:23.955782 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.955795 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.955932 (+ 137us) server_negotiation.cc:407] Connection header received
0811 04:48:23.956657 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.956663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.956860 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.957045 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:23.957248 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958417 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.959708 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.960486 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.960597 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.960769 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.961762 (+ 993us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.961853 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":130,"threads_started":1}
I20260811 04:48:23.962334 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:23.955738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47436 (local address 127.17.188.66:44079)
0811 04:48:23.956279 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:23.956291 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:23.956316 (+ 25us) server_negotiation.cc:407] Connection header received
0811 04:48:23.956406 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:23.956411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:23.956558 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:23.956722 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:23.956957 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.958072 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.959951 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:23.961070 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:23.961186 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:23.961358 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:23.962107 (+ 749us) server_negotiation.cc:299] Negotiation successful
0811 04:48:23.962202 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":116,"threads_started":1}
I20260811 04:48:23.964560 19592 tablet_service.cc:1467] Processing CreateTablet for tablet 609913c847cd4856b0e1de46fa354764 (DEFAULT_TABLE table=test-table [id=63a9166db202464c8c7177669e885d1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:23.964700 19744 tablet_service.cc:1467] Processing CreateTablet for tablet 609913c847cd4856b0e1de46fa354764 (DEFAULT_TABLE table=test-table [id=63a9166db202464c8c7177669e885d1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:23.964696 19904 tablet_service.cc:1467] Processing CreateTablet for tablet 609913c847cd4856b0e1de46fa354764 (DEFAULT_TABLE table=test-table [id=63a9166db202464c8c7177669e885d1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:23.965746 19744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 609913c847cd4856b0e1de46fa354764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:23.965752 19904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 609913c847cd4856b0e1de46fa354764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:23.965751 19592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 609913c847cd4856b0e1de46fa354764. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:23.971778 20001 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Bootstrap starting.
I20260811 04:48:23.973620 20002 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Bootstrap starting.
I20260811 04:48:23.973615 20003 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Bootstrap starting.
I20260811 04:48:23.974170 20001 tablet_bootstrap.cc:654] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:23.975047 20001 log.cc:824] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:23.975724 20002 tablet_bootstrap.cc:654] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:23.975724 20003 tablet_bootstrap.cc:654] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:23.976626 20003 log.cc:824] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:23.976655 20002 log.cc:824] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:23.977092 20001 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: No bootstrap required, opened a new log
I20260811 04:48:23.977296 20001 ts_tablet_manager.cc:1397] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:48:23.978632 20002 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: No bootstrap required, opened a new log
I20260811 04:48:23.978812 20002 ts_tablet_manager.cc:1397] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:23.978871 20003 tablet_bootstrap.cc:492] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: No bootstrap required, opened a new log
I20260811 04:48:23.979033 20003 ts_tablet_manager.cc:1397] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:48:23.980876 20001 raft_consensus.cc:348] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.981104 20001 raft_consensus.cc:374] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:23.981165 20001 raft_consensus.cc:729] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9094c393e3c44cfbe0d265f10ff42ad, State: Initialized, Role: FOLLOWER
I20260811 04:48:23.981617 20001 consensus_queue.cc:260] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.982591 20001 ts_tablet_manager.cc:1428] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:48:23.982954 19662 heartbeater.cc:503] Master 127.17.188.126:34405 was elected leader, sending a full tablet report...
I20260811 04:48:23.982816 20003 raft_consensus.cc:348] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.983040 20003 raft_consensus.cc:374] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:23.983108 20003 raft_consensus.cc:729] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3016260309b04160a8aedfcce15f0b41, State: Initialized, Role: FOLLOWER
I20260811 04:48:23.983503 20003 consensus_queue.cc:260] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.982769 20002 raft_consensus.cc:348] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.984311 19817 heartbeater.cc:503] Master 127.17.188.126:34405 was elected leader, sending a full tablet report...
I20260811 04:48:23.984337 20002 raft_consensus.cc:374] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:23.984400 20002 raft_consensus.cc:729] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa1d11e55fc4e9da7297ab314257fd8, State: Initialized, Role: FOLLOWER
I20260811 04:48:23.984623 20003 ts_tablet_manager.cc:1428] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260811 04:48:23.984841 20002 consensus_queue.cc:260] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:23.985492 19975 heartbeater.cc:503] Master 127.17.188.126:34405 was elected leader, sending a full tablet report...
I20260811 04:48:23.985716 20002 ts_tablet_manager.cc:1428] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 04:48:24.028108 20009 raft_consensus.cc:482] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:24.028347 20009 raft_consensus.cc:504] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:24.029719 20009 leader_election.cc:288] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079)
I20260811 04:48:24.033435 19854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.029921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37183 (local address 127.17.188.67:45965)
0811 04:48:24.030043 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.030071 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.030165 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.030564 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.030566 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.030584 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:24.030756 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.030768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.031617 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.031620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.032349 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.032357 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.032997 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.033001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.033121 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.033147 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.033235 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.033310 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 04:48:24.033435 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.030183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:45965 (local address 127.17.188.65:37183)
0811 04:48:24.030304 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.030308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.030319 (+ 11us) server_negotiation.cc:407] Connection header received
0811 04:48:24.030364 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.030366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.030452 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.030551 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:24.030892 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.031462 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.032479 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.032877 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.033007 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.033065 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.033255 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.033324 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 04:48:24.034138 20010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.029975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44079 (local address 127.17.188.67:33885)
0811 04:48:24.030382 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.030392 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.030505 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.030761 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.030764 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.030778 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:24.030899 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.030905 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.031735 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.031742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.033003 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.033013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.033778 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.033783 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.033874 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.033898 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.033985 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.034036 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":142,"threads_started":1}
I20260811 04:48:24.034209 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.030120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:33885 (local address 127.17.188.66:44079)
0811 04:48:24.030246 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.030250 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.030493 (+ 243us) server_negotiation.cc:407] Connection header received
0811 04:48:24.030636 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.030639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.030686 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.030751 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:24.031007 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.031630 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.033132 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.033605 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.033746 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.033787 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.034017 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.034095 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:48:24.034245 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "609913c847cd4856b0e1de46fa354764" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" is_pre_election: true
I20260811 04:48:24.034561 19613 raft_consensus.cc:2454] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 0.
I20260811 04:48:24.034785 19765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "609913c847cd4856b0e1de46fa354764" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3016260309b04160a8aedfcce15f0b41" is_pre_election: true
I20260811 04:48:24.035072 19765 raft_consensus.cc:2454] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 0.
I20260811 04:48:24.035082 19845 leader_election.cc:302] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfa1d11e55fc4e9da7297ab314257fd8, e9094c393e3c44cfbe0d265f10ff42ad; no voters:
I20260811 04:48:24.035346 20009 raft_consensus.cc:2781] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:24.035435 20009 raft_consensus.cc:482] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:24.035504 20009 raft_consensus.cc:3037] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.036528 20009 raft_consensus.cc:504] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:24.036897 20009 leader_election.cc:288] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 election: Requested vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079)
I20260811 04:48:24.037233 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "609913c847cd4856b0e1de46fa354764" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
I20260811 04:48:24.037247 19765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "609913c847cd4856b0e1de46fa354764" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3016260309b04160a8aedfcce15f0b41"
I20260811 04:48:24.037354 19613 raft_consensus.cc:3037] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.037354 19765 raft_consensus.cc:3037] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.038717 19613 raft_consensus.cc:2454] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 1.
I20260811 04:48:24.039036 19845 leader_election.cc:302] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfa1d11e55fc4e9da7297ab314257fd8, e9094c393e3c44cfbe0d265f10ff42ad; no voters:
I20260811 04:48:24.039120 19765 raft_consensus.cc:2454] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 1.
I20260811 04:48:24.039234 20009 raft_consensus.cc:2781] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:24.039474 20009 raft_consensus.cc:686] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 LEADER]: Becoming Leader. State: Replica: cfa1d11e55fc4e9da7297ab314257fd8, State: Running, Role: LEADER
I20260811 04:48:24.039804 20009 consensus_queue.cc:237] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } }
I20260811 04:48:24.042816 19434 catalog_manager.cc:5495] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } health_report { overall_health: UNKNOWN } } }
I20260811 04:48:24.061184 19999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.057243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46376 (local address 127.17.188.67:41605)
0811 04:48:24.057375 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.057380 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.057477 (+ 97us) server_negotiation.cc:407] Connection header received
0811 04:48:24.057758 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.057761 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.057823 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.057924 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:24.058185 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.058820 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.059748 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.059979 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.060084 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.060412 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.060793 (+ 381us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.060917 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.060994 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.061045 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:48:24.066668 19613 raft_consensus.cc:1261] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Refusing update from remote peer cfa1d11e55fc4e9da7297ab314257fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.066663 19765 raft_consensus.cc:1261] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Refusing update from remote peer cfa1d11e55fc4e9da7297ab314257fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.067421 20011 consensus_queue.cc:1035] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.067651 20009 consensus_queue.cc:1035] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.085737 19434 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:24.085924 19434 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:24.088280 19434 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Sending DeleteTablet for 3 replicas of tablet 609913c847cd4856b0e1de46fa354764
I20260811 04:48:24.089205 19904 tablet_service.cc:1514] Processing DeleteTablet for tablet 609913c847cd4856b0e1de46fa354764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:46370
I20260811 04:48:24.089583 19592 tablet_service.cc:1514] Processing DeleteTablet for tablet 609913c847cd4856b0e1de46fa354764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:57978
I20260811 04:48:24.090174 20028 tablet_replica.cc:330] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: stopping tablet replica
I20260811 04:48:24.090133 19434 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:24.090550 19434 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:24.090776 20028 raft_consensus.cc:2229] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:24.091162 20028 raft_consensus.cc:2258] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.092718 20028 ts_tablet_manager.cc:1905] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.095782 20028 ts_tablet_manager.cc:1918] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:24.095736 19904 tablet_service.cc:1467] Processing CreateTablet for tablet 9f36445763484d23a3946b2b59dcc372 (DEFAULT_TABLE table=test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:24.095953 20028 log.cc:1196] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/609913c847cd4856b0e1de46fa354764
I20260811 04:48:24.096022 19904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f36445763484d23a3946b2b59dcc372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.096448 20028 ts_tablet_manager.cc:1939] T 609913c847cd4856b0e1de46fa354764 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting consensus metadata
I20260811 04:48:24.096526 19744 tablet_service.cc:1514] Processing DeleteTablet for tablet 609913c847cd4856b0e1de46fa354764 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:47436
I20260811 04:48:24.097230 20027 tablet_replica.cc:330] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: stopping tablet replica
I20260811 04:48:24.097688 20027 raft_consensus.cc:2229] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:24.098186 20027 raft_consensus.cc:2258] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.098230 19415 catalog_manager.cc:4841] TS e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183): tablet 609913c847cd4856b0e1de46fa354764 (table test-table [id=63a9166db202464c8c7177669e885d1e]) successfully deleted
I20260811 04:48:24.098227 19744 tablet_service.cc:1467] Processing CreateTablet for tablet 9f36445763484d23a3946b2b59dcc372 (DEFAULT_TABLE table=test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:24.098495 19744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f36445763484d23a3946b2b59dcc372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.098704 19592 tablet_service.cc:1467] Processing CreateTablet for tablet 9f36445763484d23a3946b2b59dcc372 (DEFAULT_TABLE table=test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:24.098935 19592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f36445763484d23a3946b2b59dcc372. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.100956 20003 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Bootstrap starting.
I20260811 04:48:24.101018 20001 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Bootstrap starting.
I20260811 04:48:24.102294 20001 tablet_bootstrap.cc:654] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.102928 20003 tablet_bootstrap.cc:654] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.102993 20002 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Bootstrap starting.
I20260811 04:48:24.104092 20029 tablet_replica.cc:330] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: stopping tablet replica
I20260811 04:48:24.104300 20001 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: No bootstrap required, opened a new log
I20260811 04:48:24.104390 20001 ts_tablet_manager.cc:1397] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 04:48:24.104619 20029 raft_consensus.cc:2229] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:24.104880 20002 tablet_bootstrap.cc:654] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.105194 20029 raft_consensus.cc:2258] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.105402 20001 raft_consensus.cc:348] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.105527 20001 raft_consensus.cc:374] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.105857 20027 ts_tablet_manager.cc:1905] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.105569 20001 raft_consensus.cc:729] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9094c393e3c44cfbe0d265f10ff42ad, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.106348 20001 consensus_queue.cc:260] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.106684 20001 ts_tablet_manager.cc:1428] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 04:48:24.108894 20029 ts_tablet_manager.cc:1905] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.111146 20003 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: No bootstrap required, opened a new log
I20260811 04:48:24.111249 20003 ts_tablet_manager.cc:1397] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.004s
I20260811 04:48:24.111773 20003 raft_consensus.cc:348] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.111871 20003 raft_consensus.cc:374] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.111900 20003 raft_consensus.cc:729] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3016260309b04160a8aedfcce15f0b41, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.112020 20003 consensus_queue.cc:260] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.112330 20003 ts_tablet_manager.cc:1428] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:24.114970 20002 tablet_bootstrap.cc:492] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: No bootstrap required, opened a new log
I20260811 04:48:24.115065 20002 ts_tablet_manager.cc:1397] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260811 04:48:24.115679 20029 ts_tablet_manager.cc:1918] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:24.115775 20029 log.cc:1196] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/609913c847cd4856b0e1de46fa354764
I20260811 04:48:24.115991 20002 raft_consensus.cc:348] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.116119 20002 raft_consensus.cc:374] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.116156 20002 raft_consensus.cc:729] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa1d11e55fc4e9da7297ab314257fd8, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.116289 20002 consensus_queue.cc:260] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.116539 20002 ts_tablet_manager.cc:1428] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:24.109531 20027 ts_tablet_manager.cc:1918] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:24.117774 20027 log.cc:1196] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/609913c847cd4856b0e1de46fa354764
I20260811 04:48:24.118276 20027 ts_tablet_manager.cc:1939] T 609913c847cd4856b0e1de46fa354764 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting consensus metadata
I20260811 04:48:24.117280 20029 ts_tablet_manager.cc:1939] T 609913c847cd4856b0e1de46fa354764 P 3016260309b04160a8aedfcce15f0b41: Deleting consensus metadata
I20260811 04:48:24.119628 19417 catalog_manager.cc:4841] TS cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67:41605): tablet 609913c847cd4856b0e1de46fa354764 (table test-table [id=63a9166db202464c8c7177669e885d1e]) successfully deleted
I20260811 04:48:24.120517 19419 catalog_manager.cc:4841] TS 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079): tablet 609913c847cd4856b0e1de46fa354764 (table test-table [id=63a9166db202464c8c7177669e885d1e]) successfully deleted
W20260811 04:48:24.146688 19976 tablet.cc:2369] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:24.148624 20008 raft_consensus.cc:482] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:24.148777 20008 raft_consensus.cc:504] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.150326 20008 leader_election.cc:288] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67:41605)
I20260811 04:48:24.155862 19695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.150514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37183 (local address 127.17.188.66:59701)
0811 04:48:24.151209 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.151226 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.151331 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.151664 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.151667 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.151687 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:24.151901 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.151908 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.152851 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.152855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.154184 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.154194 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.155356 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.155360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.155540 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.155576 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.155653 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.155738 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208}
I20260811 04:48:24.156306 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.150888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:59701 (local address 127.17.188.65:37183)
0811 04:48:24.151033 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.151038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.151418 (+ 380us) server_negotiation.cc:407] Connection header received
0811 04:48:24.151498 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.151501 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.151548 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.151621 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:24.152039 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.152722 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.154559 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.155142 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.155251 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.155300 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.156126 (+ 826us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.156198 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:48:24.156894 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f36445763484d23a3946b2b59dcc372" candidate_uuid: "3016260309b04160a8aedfcce15f0b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" is_pre_election: true
I20260811 04:48:24.157042 19613 raft_consensus.cc:2454] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3016260309b04160a8aedfcce15f0b41 in term 0.
I20260811 04:48:24.157392 19999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.151114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:33057 (local address 127.17.188.67:41605)
0811 04:48:24.151253 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.151259 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.152249 (+ 990us) server_negotiation.cc:407] Connection header received
0811 04:48:24.152419 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.152423 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.152462 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.152503 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:24.153058 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.153832 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.155648 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.156408 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.156497 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.156540 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.157209 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.157281 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:48:24.157788 19687 leader_election.cc:302] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3016260309b04160a8aedfcce15f0b41, e9094c393e3c44cfbe0d265f10ff42ad; no voters:
I20260811 04:48:24.157895 20036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.151759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41605 (local address 127.17.188.66:33057)
0811 04:48:24.152119 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.152149 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.152314 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.152619 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.152622 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.152636 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:24.152910 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.152926 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.154002 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.154006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.155502 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.155513 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.156635 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.156638 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.156963 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.156989 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.157607 (+ 618us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.157680 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":82,"threads_started":1}
I20260811 04:48:24.158068 20008 raft_consensus.cc:2781] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:24.158131 20008 raft_consensus.cc:482] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:24.158178 20008 raft_consensus.cc:3037] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.158740 19926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f36445763484d23a3946b2b59dcc372" candidate_uuid: "3016260309b04160a8aedfcce15f0b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" is_pre_election: true
I20260811 04:48:24.159035 19926 raft_consensus.cc:2454] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3016260309b04160a8aedfcce15f0b41 in term 0.
I20260811 04:48:24.159696 20008 raft_consensus.cc:504] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.160019 20008 leader_election.cc:288] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [CANDIDATE]: Term 1 election: Requested vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67:41605)
I20260811 04:48:24.160408 19926 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f36445763484d23a3946b2b59dcc372" candidate_uuid: "3016260309b04160a8aedfcce15f0b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa1d11e55fc4e9da7297ab314257fd8"
I20260811 04:48:24.160516 19926 raft_consensus.cc:3037] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.160905 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f36445763484d23a3946b2b59dcc372" candidate_uuid: "3016260309b04160a8aedfcce15f0b41" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
I20260811 04:48:24.161024 19613 raft_consensus.cc:3037] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.162125 19926 raft_consensus.cc:2454] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3016260309b04160a8aedfcce15f0b41 in term 1.
I20260811 04:48:24.162425 19688 leader_election.cc:302] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3016260309b04160a8aedfcce15f0b41, cfa1d11e55fc4e9da7297ab314257fd8; no voters:
I20260811 04:48:24.162524 19613 raft_consensus.cc:2454] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3016260309b04160a8aedfcce15f0b41 in term 1.
I20260811 04:48:24.162596 20008 raft_consensus.cc:2781] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:24.162747 20008 raft_consensus.cc:686] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 1 LEADER]: Becoming Leader. State: Replica: 3016260309b04160a8aedfcce15f0b41, State: Running, Role: LEADER
I20260811 04:48:24.162979 20008 consensus_queue.cc:237] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
W20260811 04:48:24.164606 19818 tablet.cc:2369] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:24.164959 19435 catalog_manager.cc:5495] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3016260309b04160a8aedfcce15f0b41 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "3016260309b04160a8aedfcce15f0b41" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } health_report { overall_health: UNKNOWN } } }
W20260811 04:48:24.192792 19663 tablet.cc:2369] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 04:48:24 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:24.221575 20047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.211831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34405 (local address 127.0.0.1:37968)
0811 04:48:24.212255 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.212269 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.212416 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.212678 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.212681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.213158 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:24.213259 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.213266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.214141 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.214146 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.214726 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.214734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.215202 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.215206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.215287 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.216145 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:24.216158 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:24.218020 (+ 1862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:24.219898 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:24.219910 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:24.219918 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:24.220154 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:24.220431 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:24.220435 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:24.220437 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:24.220519 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:24.220919 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:24.220928 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:24.221039 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.221191 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.221374 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":172,"threads_started":1}
I20260811 04:48:24.221590 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.211889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37968 (local address 127.17.188.126:34405)
0811 04:48:24.212079 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.212086 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.212362 (+ 276us) server_negotiation.cc:407] Connection header received
0811 04:48:24.212525 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.212528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.212574 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.212659 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:24.213391 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.214020 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.214857 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.215083 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.215196 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.218168 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:24.218171 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:24.218174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:24.218204 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:24.219786 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.220255 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.220260 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.220262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.220339 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.220621 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.220624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.220626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.220802 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:24.220908 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.221239 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.221436 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":95,"server-negotiator.queue_time_us":56}
I20260811 04:48:24.227260 19435 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:37968:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 04:48:24.228004 19435 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:24.234519 19904 tablet_service.cc:1467] Processing CreateTablet for tablet 75c4b71251c24fedb3d2444e1b38137b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=98c53b7e6d8a4aadb87babed1e5ea3a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:24.234519 19592 tablet_service.cc:1467] Processing CreateTablet for tablet 75c4b71251c24fedb3d2444e1b38137b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=98c53b7e6d8a4aadb87babed1e5ea3a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:24.234608 19744 tablet_service.cc:1467] Processing CreateTablet for tablet 75c4b71251c24fedb3d2444e1b38137b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=98c53b7e6d8a4aadb87babed1e5ea3a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:24.234929 19592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c4b71251c24fedb3d2444e1b38137b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.234928 19904 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c4b71251c24fedb3d2444e1b38137b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.235033 19744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75c4b71251c24fedb3d2444e1b38137b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:24.238016 20002 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: Bootstrap starting.
I20260811 04:48:24.238564 20001 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: Bootstrap starting.
I20260811 04:48:24.239082 20003 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: Bootstrap starting.
I20260811 04:48:24.240324 20002 tablet_bootstrap.cc:654] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.240830 20003 tablet_bootstrap.cc:654] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.240863 20001 tablet_bootstrap.cc:654] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:24.242758 20002 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: No bootstrap required, opened a new log
I20260811 04:48:24.242852 20002 ts_tablet_manager.cc:1397] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:24.242960 20003 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: No bootstrap required, opened a new log
I20260811 04:48:24.243122 20003 ts_tablet_manager.cc:1397] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 04:48:24.243641 20002 raft_consensus.cc:348] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.243641 20003 raft_consensus.cc:348] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.243760 20002 raft_consensus.cc:374] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.243760 20003 raft_consensus.cc:374] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.243796 20003 raft_consensus.cc:729] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3016260309b04160a8aedfcce15f0b41, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.243796 20002 raft_consensus.cc:729] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa1d11e55fc4e9da7297ab314257fd8, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.243857 20001 tablet_bootstrap.cc:492] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: No bootstrap required, opened a new log
I20260811 04:48:24.243940 20001 ts_tablet_manager.cc:1397] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:24.243916 20003 consensus_queue.cc:260] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.243916 20002 consensus_queue.cc:260] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.244164 20002 ts_tablet_manager.cc:1428] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:24.244186 20003 ts_tablet_manager.cc:1428] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:24.244390 20009 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.244484 20009 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.244778 20001 raft_consensus.cc:348] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.244923 20001 raft_consensus.cc:374] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:24.244961 20001 raft_consensus.cc:729] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9094c393e3c44cfbe0d265f10ff42ad, State: Initialized, Role: FOLLOWER
I20260811 04:48:24.245113 20001 consensus_queue.cc:260] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.245643 20008 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.245779 20008 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.245371 20007 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.246196 20007 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.245384 20001 ts_tablet_manager.cc:1428] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:24.286754 20009 raft_consensus.cc:482] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:24.286917 20009 raft_consensus.cc:504] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.287354 20009 leader_election.cc:288] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079)
I20260811 04:48:24.287732 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c4b71251c24fedb3d2444e1b38137b" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" is_pre_election: true
I20260811 04:48:24.287866 19613 raft_consensus.cc:2454] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 0.
I20260811 04:48:24.288012 19765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c4b71251c24fedb3d2444e1b38137b" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3016260309b04160a8aedfcce15f0b41" is_pre_election: true
I20260811 04:48:24.288192 19845 leader_election.cc:302] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfa1d11e55fc4e9da7297ab314257fd8, e9094c393e3c44cfbe0d265f10ff42ad; no voters:
I20260811 04:48:24.288280 19765 raft_consensus.cc:2454] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 0.
I20260811 04:48:24.288358 20009 raft_consensus.cc:2781] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:24.288406 20009 raft_consensus.cc:482] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:24.288475 20009 raft_consensus.cc:3037] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.289641 20009 raft_consensus.cc:504] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.290037 20009 leader_election.cc:288] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 election: Requested vote from peers e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183), 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079)
I20260811 04:48:24.290390 19613 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c4b71251c24fedb3d2444e1b38137b" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9094c393e3c44cfbe0d265f10ff42ad"
I20260811 04:48:24.290508 19613 raft_consensus.cc:3037] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.290700 19765 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75c4b71251c24fedb3d2444e1b38137b" candidate_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3016260309b04160a8aedfcce15f0b41"
I20260811 04:48:24.290809 19765 raft_consensus.cc:3037] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:24.291495 19613 raft_consensus.cc:2454] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 1.
I20260811 04:48:24.291774 19845 leader_election.cc:302] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cfa1d11e55fc4e9da7297ab314257fd8, e9094c393e3c44cfbe0d265f10ff42ad; no voters:
I20260811 04:48:24.291838 19765 raft_consensus.cc:2454] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa1d11e55fc4e9da7297ab314257fd8 in term 1.
I20260811 04:48:24.291980 20009 raft_consensus.cc:2781] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:24.292069 20009 raft_consensus.cc:686] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 LEADER]: Becoming Leader. State: Replica: cfa1d11e55fc4e9da7297ab314257fd8, State: Running, Role: LEADER
I20260811 04:48:24.292207 20009 consensus_queue.cc:237] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } }
I20260811 04:48:24.293023 20009 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: TxnStatusTablet state changed. Reason: New leader cfa1d11e55fc4e9da7297ab314257fd8. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.293174 20009 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:24.294029 19434 catalog_manager.cc:5495] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:24.294832 20053 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 04:48:24.295013 20053 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 04:48:24.310879 20047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.306386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41605 (local address 127.0.0.1:46382)
0811 04:48:24.306649 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.306667 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.306782 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.307236 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.307240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.307263 (+ 23us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:24.307450 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.307456 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.308526 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.308530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.309200 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.309211 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.309937 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.309942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.310122 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.310185 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.310582 (+ 397us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.310590 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.310660 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.310750 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260811 04:48:24.310879 19999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.306513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46382 (local address 127.17.188.67:41605)
0811 04:48:24.306716 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.306721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.306737 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:24.306943 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.306946 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.307056 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.307159 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:24.307614 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.308418 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.309378 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.309677 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.309812 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.310355 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.310450 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.310498 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.310688 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.310740 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:24.313800 19613 raft_consensus.cc:1261] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Refusing update from remote peer cfa1d11e55fc4e9da7297ab314257fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.313877 19765 raft_consensus.cc:1261] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Refusing update from remote peer cfa1d11e55fc4e9da7297ab314257fd8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.314221 20009 consensus_queue.cc:1035] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.314422 20022 consensus_queue.cc:1035] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.316344 20007 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: TxnStatusTablet state changed. Reason: New leader cfa1d11e55fc4e9da7297ab314257fd8. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.316458 20007 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.316774 20008 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: TxnStatusTablet state changed. Reason: New leader cfa1d11e55fc4e9da7297ab314257fd8. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.316923 20008 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.318774 20011 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.318892 20011 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:24.318974 20015 mvcc.cc:205] Tried to move back new op lower bound from 7317191492864421888 to 7317191492782297088. Current Snapshot: MvccSnapshot[applied={T|T < 7317191492864421888 or (T in {7317191492864421888})}]
I20260811 04:48:24.318794 20009 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.319388 20009 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P cfa1d11e55fc4e9da7297ab314257fd8: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:24.319988 20007 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.320106 20007 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P e9094c393e3c44cfbe0d265f10ff42ad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.320353 20018 mvcc.cc:205] Tried to move back new op lower bound from 7317191492864421888 to 7317191492782297088. Current Snapshot: MvccSnapshot[applied={T|T < 7317191492864421888 or (T in {7317191492864421888})}]
I20260811 04:48:24.323240 20008 tablet_replica.cc:439] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 } } peers { permanent_uuid: "3016260309b04160a8aedfcce15f0b41" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44079 } } peers { permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 } } }
I20260811 04:48:24.323359 20008 tablet_replica.cc:442] T 75c4b71251c24fedb3d2444e1b38137b P 3016260309b04160a8aedfcce15f0b41: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:24.330787 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.325985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47442 (local address 127.17.188.66:44079)
0811 04:48:24.326147 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.326153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.326169 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:24.326332 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.326336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.326398 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.326502 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:24.326758 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.327645 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.328465 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.328841 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.328953 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.329395 (+ 442us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.330059 (+ 664us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.330222 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.330539 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.330603 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 04:48:24.343338 19999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.339048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:37307 (local address 127.17.188.67:41605)
0811 04:48:24.339174 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.339180 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.339194 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:24.339239 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.339243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.339288 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.339347 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:24.340110 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.340808 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.342243 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.342464 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.342573 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.342899 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.342995 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.343074 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.343163 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.343209 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:24.343355 20061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.338652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41605 (local address 127.17.188.66:37307)
0811 04:48:24.338992 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.339005 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.339096 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.339477 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.339481 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.339490 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:24.339619 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.339624 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.340943 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.340952 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.342129 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.342140 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.342585 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.342589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.342706 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.342759 (+ 53us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.343077 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.343085 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.343150 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.343220 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":139,"threads_started":1}
I20260811 04:48:24.350464 19926 raft_consensus.cc:1261] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Refusing update from remote peer 3016260309b04160a8aedfcce15f0b41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.350857 19613 raft_consensus.cc:1261] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Refusing update from remote peer 3016260309b04160a8aedfcce15f0b41: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:24.350999 20037 consensus_queue.cc:1035] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa1d11e55fc4e9da7297ab314257fd8" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.351279 20008 consensus_queue.cc:1035] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9094c393e3c44cfbe0d265f10ff42ad" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:24.357766 20016 mvcc.cc:205] Tried to move back new op lower bound from 7317191493014360064 to 7317191492253888512. Current Snapshot: MvccSnapshot[applied={T|T < 7317191493014360064}]
I20260811 04:48:24.374392 20000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.370905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:33625 (local address 127.17.188.66:44079)
0811 04:48:24.371010 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.371015 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.371073 (+ 58us) server_negotiation.cc:407] Connection header received
0811 04:48:24.371172 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.371175 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.371219 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.371294 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:24.371480 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.372202 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.373381 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.373634 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.373745 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.374034 (+ 289us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.374097 (+ 63us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.374152 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.374256 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.374296 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:48:24.374456 19982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.370866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44079 (local address 127.17.188.67:33625)
0811 04:48:24.371006 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:24.371021 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:24.371104 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:24.371308 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:24.371309 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:24.371315 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:24.371392 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.371395 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.372348 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.372351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.373267 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:24.373277 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.373762 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.373766 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:24.373853 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.373904 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:24.374174 (+ 270us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:24.374180 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 04:48:24.374250 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 04:48:24.374327 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 04:48:24.396855 19434 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:24.397022 19434 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:24.399117 19434 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1952eb454d7a4e9587ff9a7dd427175f: Sending DeleteTablet for 3 replicas of tablet 9f36445763484d23a3946b2b59dcc372
I20260811 04:48:24.399641 19592 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f36445763484d23a3946b2b59dcc372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:57978
I20260811 04:48:24.399806 20028 tablet_replica.cc:330] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: stopping tablet replica
I20260811 04:48:24.399896 20028 raft_consensus.cc:2229] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:24.399879 19904 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f36445763484d23a3946b2b59dcc372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:46370
I20260811 04:48:24.400012 20028 raft_consensus.cc:2258] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.400046 20027 tablet_replica.cc:330] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: stopping tablet replica
I20260811 04:48:24.400170 20027 raft_consensus.cc:2229] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:24.400267 20027 raft_consensus.cc:2258] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.400727 19744 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f36445763484d23a3946b2b59dcc372 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:24 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:47436
I20260811 04:48:24.400939 20029 tablet_replica.cc:330] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: stopping tablet replica
I20260811 04:48:24.401034 20029 raft_consensus.cc:2229] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:24.401041 20028 ts_tablet_manager.cc:1905] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.401296 20029 raft_consensus.cc:2258] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:24.401868 20027 ts_tablet_manager.cc:1905] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.403842 20028 ts_tablet_manager.cc:1918] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:24.403911 20028 log.cc:1196] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/9f36445763484d23a3946b2b59dcc372
I20260811 04:48:24.403915 20027 ts_tablet_manager.cc:1918] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:24.403970 20027 log.cc:1196] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9f36445763484d23a3946b2b59dcc372
I20260811 04:48:24.404183 20027 ts_tablet_manager.cc:1939] T 9f36445763484d23a3946b2b59dcc372 P cfa1d11e55fc4e9da7297ab314257fd8: Deleting consensus metadata
I20260811 04:48:24.404186 20028 ts_tablet_manager.cc:1939] T 9f36445763484d23a3946b2b59dcc372 P e9094c393e3c44cfbe0d265f10ff42ad: Deleting consensus metadata
I20260811 04:48:24.404763 19417 catalog_manager.cc:4841] TS cfa1d11e55fc4e9da7297ab314257fd8 (127.17.188.67:41605): tablet 9f36445763484d23a3946b2b59dcc372 (table test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]) successfully deleted
I20260811 04:48:24.404785 19415 catalog_manager.cc:4841] TS e9094c393e3c44cfbe0d265f10ff42ad (127.17.188.65:37183): tablet 9f36445763484d23a3946b2b59dcc372 (table test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]) successfully deleted
I20260811 04:48:24.405169 20029 ts_tablet_manager.cc:1905] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:24.408145 20029 ts_tablet_manager.cc:1918] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:24.408264 20029 log.cc:1196] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9f36445763484d23a3946b2b59dcc372
I20260811 04:48:24.408548 20029 ts_tablet_manager.cc:1939] T 9f36445763484d23a3946b2b59dcc372 P 3016260309b04160a8aedfcce15f0b41: Deleting consensus metadata
I20260811 04:48:24.409333 19419 catalog_manager.cc:4841] TS 3016260309b04160a8aedfcce15f0b41 (127.17.188.66:44079): tablet 9f36445763484d23a3946b2b59dcc372 (table test-table [id=c20af0e8e8b945b3a2a06bed70e919e1]) successfully deleted
Aug 11 04:48:24 dist-test-slave-njxd krb5kdc[19380](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423703, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:24.420115 19997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.405517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.17.188.65:37183)
0811 04:48:24.405651 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.405656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.406412 (+ 756us) server_negotiation.cc:407] Connection header received
0811 04:48:24.406613 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.406616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.406665 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.406715 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:24.407703 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.408497 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.410402 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.410747 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.410844 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.415673 (+ 4829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:24.415686 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:24.415703 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:24.415732 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:24.418010 (+ 2278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.418536 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.418558 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.418561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.418670 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.418987 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.418990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.418992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.419305 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:24.419584 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.419760 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.419886 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 04:48:24.420639 19656 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57986
I20260811 04:48:24.431759 19489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:24.422636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37984 (local address 127.17.188.126:34405)
0811 04:48:24.422784 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:24.422789 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:24.422803 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:24.422920 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:24.422923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:24.422969 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:24.423050 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:24.423828 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.424705 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.425873 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:24.426270 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:24.426380 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:24.427946 (+ 1566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:24.427950 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:24.427953 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:24.427991 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:24.429676 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.430199 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.430203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.430205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.430299 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:24.430620 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:24.430624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:24.430626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:24.430892 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:24.431015 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:24.431417 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 04:48:24.431572 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 04:48:24.432439 19434 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37984
I20260811 04:48:24.434430 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19513
I20260811 04:48:24.447256 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19671
I20260811 04:48:24.457710 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19828
I20260811 04:48:24.465485 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 19395
2026-08-11T04:48:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2723 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:24 dist-test-slave-njxd krb5kdc[20074](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:24 dist-test-slave-njxd krb5kdc[20074](info): set up 2 sockets
Aug 11 04:48:24 dist-test-slave-njxd krb5kdc[20074](info): commencing operation
krb5kdc: starting...
W20260811 04:48:25.546085 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:25 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:25.662791 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41457
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:25.774186 20087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:25.774505 20087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:25.774603 20087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:25.778847 20087 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:25.778944 20087 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 04:48:25.778980 20087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:25.779021 20087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:25.779057 20087 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:25.779120 20087 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:25.784582 20087 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41457
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20087
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:25.785732 20087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:25.786803 20087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:25.795578 20087 server_base.cc:1034] running on GCE node
W20260811 04:48:25.795538 20095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:25.795522 20093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:25.795518 20092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:25.796355 20087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:25.797495 20087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:25.798693 20087 hybrid_clock.cc:648] HybridClock initialized: now 1786423705798674 us; error 32 us; skew 500 ppm
Aug 11 04:48:25 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:25.801457 20087 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:25.802368 20087 webserver.cc:460] Webserver started at http://127.17.188.126:39881/ using document root <none> and password file <none>
I20260811 04:48:25.802919 20087 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:25.803009 20087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:25.803252 20087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:25.805294 20087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "b949ec5056c541bcbf82b9e56a941eb6"
format_stamp: "Formatted at 2026-08-11 04:48:25 on dist-test-slave-njxd"
server_key: "e9cb73ae1bcc9e65d4ea19f1f86090ad"
server_key_iv: "21f7d43a7e5641b9fbb1d5414dfe7258"
server_key_version: "encryptionkey@0"
I20260811 04:48:25.805910 20087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "b949ec5056c541bcbf82b9e56a941eb6"
format_stamp: "Formatted at 2026-08-11 04:48:25 on dist-test-slave-njxd"
server_key: "e9cb73ae1bcc9e65d4ea19f1f86090ad"
server_key_iv: "21f7d43a7e5641b9fbb1d5414dfe7258"
server_key_version: "encryptionkey@0"
I20260811 04:48:25.809547 20087 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:48:25.811884 20102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:25.813117 20087 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:25.813258 20087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "b949ec5056c541bcbf82b9e56a941eb6"
format_stamp: "Formatted at 2026-08-11 04:48:25 on dist-test-slave-njxd"
server_key: "e9cb73ae1bcc9e65d4ea19f1f86090ad"
server_key_iv: "21f7d43a7e5641b9fbb1d5414dfe7258"
server_key_version: "encryptionkey@0"
I20260811 04:48:25.813367 20087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:25.829198 20087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:25.832351 20087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:25.832527 20087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:25.840363 20087 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:41457
I20260811 04:48:25.840459 20174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:41457 every 8 connection(s)
I20260811 04:48:25.841331 20087 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:25.844163 20175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:25.849617 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20087
I20260811 04:48:25.849735 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:25.849781 20175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Bootstrap starting.
I20260811 04:48:25.850024 18161 external_mini_cluster.cc:1428] Setting key c3e1598431e6b44ffec033dbd24aba87
I20260811 04:48:25.852371 20175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:25.853135 20175 log.cc:824] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:25.855392 20175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: No bootstrap required, opened a new log
Aug 11 04:48:25 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423705, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:25.859822 20175 raft_consensus.cc:348] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } }
I20260811 04:48:25.860076 20175 raft_consensus.cc:374] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:25.860160 20175 raft_consensus.cc:729] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b949ec5056c541bcbf82b9e56a941eb6, State: Initialized, Role: FOLLOWER
I20260811 04:48:25.860584 20175 consensus_queue.cc:260] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } }
I20260811 04:48:25.860738 20175 raft_consensus.cc:388] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:25.860827 20175 raft_consensus.cc:482] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:25.860939 20175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:25.861881 20175 raft_consensus.cc:504] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } }
I20260811 04:48:25.862210 20175 leader_election.cc:302] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b949ec5056c541bcbf82b9e56a941eb6; no voters:
I20260811 04:48:25.862553 20175 leader_election.cc:288] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:25.862649 20180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:25.862823 20180 raft_consensus.cc:686] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [term 1 LEADER]: Becoming Leader. State: Replica: b949ec5056c541bcbf82b9e56a941eb6, State: Running, Role: LEADER
I20260811 04:48:25.863122 20180 consensus_queue.cc:237] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } }
I20260811 04:48:25.863838 20175 sys_catalog.cc:564] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:25.864261 20180 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b949ec5056c541bcbf82b9e56a941eb6. Latest consensus state: current_term: 1 leader_uuid: "b949ec5056c541bcbf82b9e56a941eb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } } }
I20260811 04:48:25.864368 20180 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:25.864755 20185 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:25.864816 20182 sys_catalog.cc:455] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b949ec5056c541bcbf82b9e56a941eb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b949ec5056c541bcbf82b9e56a941eb6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41457 } } }
I20260811 04:48:25.864926 20182 sys_catalog.cc:458] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:25.866532 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:25.851360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55610 (local address 127.17.188.126:41457)
0811 04:48:25.851799 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:25.851814 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:25.851850 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:48:25.852488 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:25.852517 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:25.852846 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:25.853114 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:25.854014 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:25.855108 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:25.856277 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:25.856789 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:25.856914 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:25.859949 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:25.859955 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:25.859970 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:25.859998 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:25.862085 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:25.862630 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:25.862639 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:25.862647 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:25.862797 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:25.863136 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:25.863139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:25.863141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:25.863613 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:25.863837 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:25.865186 (+ 1349us) server_negotiation.cc:299] Negotiation successful
0811 04:48:25.865523 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":139,"threads_started":1}
I20260811 04:48:25.868196 20185 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:25.874070 20185 catalog_manager.cc:1347] Generated new cluster ID: c2589ea2a40a42c6b1942f28367eaaac
I20260811 04:48:25.874155 20185 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:25.890461 20185 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:25.892104 20185 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:25.895844 20185 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Generated new TSK 0
I20260811 04:48:25.896495 20185 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:25.930863 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41457
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:26.046020 20204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:26.046276 20204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:26.046355 20204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:26.050302 20204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:26.050371 20204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:26.050436 20204 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 04:48:26.050477 20204 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:26.050541 20204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:26.055560 20204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:26.056494 20204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:26.057446 20204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:26.066910 20214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:26.066920 20212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:26.066993 20204 server_base.cc:1034] running on GCE node
W20260811 04:48:26.066922 20210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:26.067592 20204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:26.068128 20204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:26.069316 20204 hybrid_clock.cc:648] HybridClock initialized: now 1786423706069284 us; error 40 us; skew 500 ppm
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:26.072026 20204 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:26.072840 20204 webserver.cc:460] Webserver started at http://127.17.188.65:39003/ using document root <none> and password file <none>
I20260811 04:48:26.073390 20204 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:26.073480 20204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:26.073750 20204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:26.075721 20204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "64e2f36339d640e1b7b05351ecbd01e3"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "f783b2134a41a9acb9054f93c68267d2"
server_key_iv: "ee42680b97c03e720428adcc967d3187"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.076323 20204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "64e2f36339d640e1b7b05351ecbd01e3"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "f783b2134a41a9acb9054f93c68267d2"
server_key_iv: "ee42680b97c03e720428adcc967d3187"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.080649 20204 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 04:48:26.083020 20222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.084183 20204 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:26.084321 20204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "64e2f36339d640e1b7b05351ecbd01e3"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "f783b2134a41a9acb9054f93c68267d2"
server_key_iv: "ee42680b97c03e720428adcc967d3187"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.084434 20204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:26.092676 20204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:26.095374 20204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:26.095566 20204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:26.096904 20204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:26.096978 20204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.097048 20204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:26.097100 20204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:26.108229 20204 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:46429
I20260811 04:48:26.108417 20351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:46429 every 8 connection(s)
I20260811 04:48:26.109248 20204 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:26.111244 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.097856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:42317 (local address 127.17.188.126:41457)
0811 04:48:26.097992 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.097997 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.098925 (+ 928us) server_negotiation.cc:407] Connection header received
0811 04:48:26.099962 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.099966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.100028 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.100101 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.101854 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.102490 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.103653 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.103940 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.104086 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.107218 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.107222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.107224 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.107250 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.108918 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.109493 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.109496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.109497 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.109641 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.110067 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.110071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.110072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.110298 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.110425 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.110925 (+ 500us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.111068 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 04:48:26.111965 20232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.098316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.65:42317)
0811 04:48:26.098778 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.098818 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.099699 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.100534 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.100545 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.101010 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.101676 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.101691 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.102622 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.102626 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.103512 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.103522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.104159 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.104165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.104405 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.105061 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.105080 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.107018 (+ 1938us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.109032 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.109038 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.109051 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.109397 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.109769 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.109774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.109779 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.109958 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.110434 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.110444 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.110684 (+ 240us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.110881 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.111200 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":121,"threads_started":1}
I20260811 04:48:26.113165 20353 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41457
I20260811 04:48:26.113322 20353 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:26.113862 20353 heartbeater.cc:511] Master 127.17.188.126:41457 requested a full tablet report, sending...
I20260811 04:48:26.115362 20122 ts_manager.cc:194] Registered new tserver with Master: 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429)
I20260811 04:48:26.116539 20122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:42317
I20260811 04:48:26.118368 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20204
I20260811 04:48:26.118489 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:26.118809 18161 external_mini_cluster.cc:1428] Setting key dda99839606b8386932f65b9eca84df8
I20260811 04:48:26.124532 20362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.115420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.65:40219)
0811 04:48:26.117238 (+ 1818us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.117251 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.117358 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.117631 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.117633 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.117842 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.117969 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.117977 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.118843 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.118846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.119543 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.119552 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.120017 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.120020 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.120125 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.120634 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.120647 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.120944 (+ 297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.122993 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.122996 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.122997 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.123201 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.123511 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.123513 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.123514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.123587 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.124088 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.124091 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.124175 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.124273 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.124389 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1730,"thread_start_us":108,"threads_started":1}
I20260811 04:48:26.124729 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.115488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:40219 (local address 127.17.188.126:41457)
0811 04:48:26.115607 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.115611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.117320 (+ 1709us) server_negotiation.cc:407] Connection header received
0811 04:48:26.117462 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.117465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.117506 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.117638 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.118089 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.118711 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.119658 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.119896 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.120001 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.121080 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.121084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.121087 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.121110 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.122867 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.123312 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.123317 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.123321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.123417 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.123684 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.123689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.123694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.123956 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.124073 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.124357 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.124490 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:26.148049 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41457
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:26.260250 20365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:26.260557 20365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:26.260641 20365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:26.265401 20365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:26.265478 20365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:26.265549 20365 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 04:48:26.265609 20365 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:26.265676 20365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:26.270869 20365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:26.271937 20365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:26.272951 20365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:26.282435 20371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:26.282429 20374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:26.282512 20372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:26.282444 20365 server_base.cc:1034] running on GCE node
I20260811 04:48:26.283064 20365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:26.283686 20365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:26.284849 20365 hybrid_clock.cc:648] HybridClock initialized: now 1786423706284818 us; error 41 us; skew 500 ppm
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:26.287719 20365 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:26.288769 20365 webserver.cc:460] Webserver started at http://127.17.188.66:34557/ using document root <none> and password file <none>
I20260811 04:48:26.289367 20365 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:26.289458 20365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:26.289748 20365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:26.291807 20365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "fe9e42b144f5486baded5720375b1da4"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "11ae450ecc286f5f8c4d37ecd736924f"
server_key_iv: "7d23e1f53af566935fbebc429ad55cb3"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.292377 20365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "fe9e42b144f5486baded5720375b1da4"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "11ae450ecc286f5f8c4d37ecd736924f"
server_key_iv: "7d23e1f53af566935fbebc429ad55cb3"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.296228 20365 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:26.298630 20382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.299870 20365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:26.300010 20365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "fe9e42b144f5486baded5720375b1da4"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "11ae450ecc286f5f8c4d37ecd736924f"
server_key_iv: "7d23e1f53af566935fbebc429ad55cb3"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.300122 20365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:26.318351 20365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:26.321249 20365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:26.321455 20365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:26.323019 20365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:26.323092 20365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.323149 20365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:26.323201 20365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:26.335398 20365 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38019
I20260811 04:48:26.335528 20513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38019 every 8 connection(s)
I20260811 04:48:26.336483 20365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:26.338511 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.323994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:51649 (local address 127.17.188.126:41457)
0811 04:48:26.324139 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.324144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.325191 (+ 1047us) server_negotiation.cc:407] Connection header received
0811 04:48:26.326201 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.326205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.326266 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.326382 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.328079 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.328979 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.331184 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.331521 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.331650 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.334533 (+ 2883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.334535 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.334538 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.334572 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.336318 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.336930 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.336933 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.336935 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.337031 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.337478 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.337484 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.337486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.337745 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.337854 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.338296 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.338394 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:26.339268 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.324532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.66:51649)
0811 04:48:26.325029 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.325076 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.325980 (+ 904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.326611 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.326623 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.327179 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.327878 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.327903 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.329158 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.329164 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.331019 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.331031 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.331698 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.331703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.331917 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.332475 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.332508 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.334364 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.336432 (+ 2068us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.336436 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.336447 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.336766 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.337157 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.337162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.337166 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.337359 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.337858 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.337863 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.338078 (+ 215us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.338227 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.338463 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":139,"threads_started":1}
I20260811 04:48:26.340265 20514 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41457
I20260811 04:48:26.340390 20514 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:26.340883 20514 heartbeater.cc:511] Master 127.17.188.126:41457 requested a full tablet report, sending...
I20260811 04:48:26.341936 20123 ts_manager.cc:194] Registered new tserver with Master: fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:26.342741 20123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:51649
I20260811 04:48:26.344663 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20365
I20260811 04:48:26.344795 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:26.345083 18161 external_mini_cluster.cc:1428] Setting key 3b846f24e6024575a6671dc6fd1cb865
I20260811 04:48:26.349658 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.342553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:46881 (local address 127.17.188.126:41457)
0811 04:48:26.342673 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.342676 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.342888 (+ 212us) server_negotiation.cc:407] Connection header received
0811 04:48:26.343086 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.343089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.343131 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.343217 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.343708 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.344187 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.345201 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.345427 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.345534 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.346628 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.346632 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.346634 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.346656 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.347981 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.348425 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.348428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.348430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.348509 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.348793 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.348797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.348799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.349019 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.349139 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.349396 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.349497 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:26.349669 20520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.342480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.66:46881)
0811 04:48:26.342797 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.342808 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.342972 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.343236 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.343238 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.343463 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.343596 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.343603 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.344314 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.344318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.345081 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.345090 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.345541 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.345544 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.345683 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.346165 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.346179 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.346491 (+ 312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.348109 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.348112 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.348114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.348320 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.348606 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.348609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.348611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.348700 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.349129 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.349132 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.349227 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.349330 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.349463 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:26.374243 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41457
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:26.485217 20523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:26.485466 20523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:26.485510 20523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:26.489691 20523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:26.489770 20523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:26.489848 20523 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 04:48:26.489881 20523 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:26.489964 20523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:26.495227 20523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:41457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:26.496300 20523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:26.497339 20523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:26.507437 20528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:26.507535 20529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:26.507537 20523 server_base.cc:1034] running on GCE node
W20260811 04:48:26.507449 20531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:26.508232 20523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:26.508868 20523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:26.510051 20523 hybrid_clock.cc:648] HybridClock initialized: now 1786423706510033 us; error 25 us; skew 500 ppm
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:26.513530 20523 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:26.514539 20523 webserver.cc:460] Webserver started at http://127.17.188.67:43415/ using document root <none> and password file <none>
I20260811 04:48:26.515133 20523 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:26.515196 20523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:26.515367 20523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:26.517676 20523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "d1022be82d954d8ba0e3fcfe915d164d"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "432cbd35dcb8a849eb1693faed40f792"
server_key_iv: "aa66fe9c1de52e8f9d54f6dccaface79"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.518283 20523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "d1022be82d954d8ba0e3fcfe915d164d"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "432cbd35dcb8a849eb1693faed40f792"
server_key_iv: "aa66fe9c1de52e8f9d54f6dccaface79"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.522051 20523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 04:48:26.524551 20540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.525877 20523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:26.525974 20523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "d1022be82d954d8ba0e3fcfe915d164d"
format_stamp: "Formatted at 2026-08-11 04:48:26 on dist-test-slave-njxd"
server_key: "432cbd35dcb8a849eb1693faed40f792"
server_key_iv: "aa66fe9c1de52e8f9d54f6dccaface79"
server_key_version: "encryptionkey@0"
I20260811 04:48:26.526064 20523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:26.541044 20523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:26.544175 20523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:26.544341 20523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:26.545836 20523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:26.545888 20523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:26.545930 20523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:26.545989 20523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:26.558139 20523 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:42263
I20260811 04:48:26.558211 20667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:42263 every 8 connection(s)
I20260811 04:48:26.559307 20523 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:26.560966 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20523
I20260811 04:48:26.561100 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:26.561384 18161 external_mini_cluster.cc:1428] Setting key 6906971ff6928263c13cb9d0c76addb8
I20260811 04:48:26.561529 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.546708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:55509 (local address 127.17.188.126:41457)
0811 04:48:26.546845 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.546849 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.547923 (+ 1074us) server_negotiation.cc:407] Connection header received
0811 04:48:26.548996 (+ 1073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.549002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.549093 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.549164 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.551083 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.552082 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.553921 (+ 1839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.554359 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.554496 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.557541 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.557545 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.557548 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.557611 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.559328 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.559931 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.559937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.559939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.560032 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.560389 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.560393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.560395 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.560589 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.560700 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.561228 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.561355 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:26.562469 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.547269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.67:55509)
0811 04:48:26.547766 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.547810 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.548713 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.549701 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.549712 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.550225 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.550899 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.550919 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.552232 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.552237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.553767 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.553776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.554558 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.554564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.554783 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.555423 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.555440 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.557367 (+ 1927us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.559453 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.559461 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.559476 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.559797 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.560135 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.560138 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.560140 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.560288 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.560697 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.560704 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.560954 (+ 250us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.561183 (+ 229us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.561497 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":140,"threads_started":1}
I20260811 04:48:26.563836 20669 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41457
I20260811 04:48:26.563972 20669 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:26.564545 20669 heartbeater.cc:511] Master 127.17.188.126:41457 requested a full tablet report, sending...
I20260811 04:48:26.565667 20123 ts_manager.cc:194] Registered new tserver with Master: d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:26.566452 20123 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:55509
I20260811 04:48:26.573031 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.566148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.17.188.67:46661)
0811 04:48:26.566421 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.566438 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.566544 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.566955 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.566958 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.567192 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.567326 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.567334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.568130 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.568133 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.568765 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.568775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.569182 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.569184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.569249 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.569990 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.570001 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.570306 (+ 305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.571720 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.571722 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.571724 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.571912 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.572159 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.572161 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.572162 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.572234 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.572589 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.572592 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.572676 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.572781 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.572895 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":2,"thread_start_us":107,"threads_started":1}
I20260811 04:48:26.573035 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.566220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:46661 (local address 127.17.188.126:41457)
0811 04:48:26.566346 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.566351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.566514 (+ 163us) server_negotiation.cc:407] Connection header received
0811 04:48:26.566697 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.566701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.566756 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.566829 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.567475 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.567988 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.568875 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.569085 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.569164 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.570429 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.570432 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.570434 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.570456 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.571627 (+ 1171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.571996 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.571998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.571999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.572071 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.572312 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.572314 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.572315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.572477 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.572555 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.572838 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.572930 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:26.575950 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:26.604395 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.595710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55622 (local address 127.17.188.126:41457)
0811 04:48:26.595858 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.595861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.595874 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:26.595915 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.595918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.595957 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.596051 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.596760 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.597291 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.598241 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.598459 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.598568 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.600920 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.600924 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.600926 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.600950 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.602467 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.603072 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.603076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.603078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.603189 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.603520 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.603523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.603525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.603718 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.603860 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.604104 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.604222 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 04:48:26.607472 20123 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:26.610541 20123 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:26.625656 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.619251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38019 (local address 127.0.0.1:39422)
0811 04:48:26.619988 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.620042 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.620185 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.620901 (+ 716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.620907 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.620931 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.621069 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.621079 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.622510 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.622513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.623831 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.623841 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.624877 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.624881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.625156 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.625199 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.625313 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.625432 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":75,"thread_start_us":89,"threads_started":1}
I20260811 04:48:26.625797 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.620050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58354 (local address 127.17.188.65:46429)
0811 04:48:26.620719 (+ 669us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.620724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.620743 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:48:26.620834 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.620841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.621020 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.621184 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.621448 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.622374 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.624310 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.625155 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.625282 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.625420 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.625521 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.625654 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":89,"threads_started":1}
I20260811 04:48:26.625793 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.619331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:46429 (local address 127.0.0.1:58354)
0811 04:48:26.620431 (+ 1100us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.620444 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.620538 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.621186 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.621189 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.621209 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.621318 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.621324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.622479 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.622484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.624095 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.624106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.625284 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.625287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.625381 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.625403 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.625490 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.625564 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1039,"mutex_wait_us":56,"thread_start_us":81,"threads_started":1}
I20260811 04:48:26.626272 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.619394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39422 (local address 127.17.188.66:38019)
0811 04:48:26.619773 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.619787 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.620361 (+ 574us) server_negotiation.cc:407] Connection header received
0811 04:48:26.620452 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.620458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.620683 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.620857 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.621194 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.622367 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.623983 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.624747 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.624863 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.625029 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.626004 (+ 975us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.626124 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":168,"threads_started":1}
I20260811 04:48:26.626981 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.619978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.0.0.1:49094)
0811 04:48:26.621363 (+ 1385us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.621374 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.621490 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.621937 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.621940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.621959 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.622040 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.622046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.623393 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.623398 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.624533 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.624542 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.626251 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.626255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.626716 (+ 461us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.626739 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.626806 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.626880 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1332,"thread_start_us":91,"threads_started":1}
I20260811 04:48:26.627503 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.620416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49094 (local address 127.17.188.67:42263)
0811 04:48:26.620970 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.620984 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.621475 (+ 491us) server_negotiation.cc:407] Connection header received
0811 04:48:26.621616 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.621621 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.621788 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.621936 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.622163 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.623272 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.624654 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.625465 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.625562 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.627241 (+ 1679us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.627300 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.627396 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":100,"threads_started":1}
I20260811 04:48:26.628660 20276 tablet_service.cc:1467] Processing CreateTablet for tablet b01d8b2f605b49c0a0917103f99354c9 (DEFAULT_TABLE table=test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:26.629745 20276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01d8b2f605b49c0a0917103f99354c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.635432 20422 tablet_service.cc:1467] Processing CreateTablet for tablet b01d8b2f605b49c0a0917103f99354c9 (DEFAULT_TABLE table=test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:26.636014 20597 tablet_service.cc:1467] Processing CreateTablet for tablet b01d8b2f605b49c0a0917103f99354c9 (DEFAULT_TABLE table=test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:26.636662 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01d8b2f605b49c0a0917103f99354c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.637169 20597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01d8b2f605b49c0a0917103f99354c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.638938 20694 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Bootstrap starting.
I20260811 04:48:26.641727 20694 tablet_bootstrap.cc:654] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.642648 20694 log.cc:824] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:26.644659 20696 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Bootstrap starting.
I20260811 04:48:26.644840 20694 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: No bootstrap required, opened a new log
I20260811 04:48:26.645278 20694 ts_tablet_manager.cc:1397] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 04:48:26.645367 20697 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Bootstrap starting.
I20260811 04:48:26.646874 20696 tablet_bootstrap.cc:654] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.647473 20697 tablet_bootstrap.cc:654] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.647631 20696 log.cc:824] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:26.648274 20697 log.cc:824] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:26.649641 20696 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: No bootstrap required, opened a new log
I20260811 04:48:26.649858 20696 ts_tablet_manager.cc:1397] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:48:26.649732 20694 raft_consensus.cc:348] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.650020 20694 raft_consensus.cc:374] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.650085 20694 raft_consensus.cc:729] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.650388 20697 tablet_bootstrap.cc:492] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: No bootstrap required, opened a new log
I20260811 04:48:26.650552 20697 ts_tablet_manager.cc:1397] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:26.650579 20694 consensus_queue.cc:260] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.651271 20353 heartbeater.cc:503] Master 127.17.188.126:41457 was elected leader, sending a full tablet report...
I20260811 04:48:26.652700 20694 ts_tablet_manager.cc:1428] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 04:48:26.653384 20696 raft_consensus.cc:348] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.653697 20696 raft_consensus.cc:374] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.653775 20696 raft_consensus.cc:729] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.654170 20697 raft_consensus.cc:348] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.654232 20696 consensus_queue.cc:260] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.654384 20697 raft_consensus.cc:374] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.654452 20697 raft_consensus.cc:729] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.654884 20697 consensus_queue.cc:260] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.655267 20696 ts_tablet_manager.cc:1428] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:48:26.655448 20514 heartbeater.cc:503] Master 127.17.188.126:41457 was elected leader, sending a full tablet report...
I20260811 04:48:26.655787 20669 heartbeater.cc:503] Master 127.17.188.126:41457 was elected leader, sending a full tablet report...
I20260811 04:48:26.656010 20697 ts_tablet_manager.cc:1428] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:48:26.680600 20702 raft_consensus.cc:482] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:26.680836 20702 raft_consensus.cc:504] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.682147 20702 leader_election.cc:288] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:26.686555 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.682522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:51297 (local address 127.17.188.67:42263)
0811 04:48:26.682650 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.682655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.682773 (+ 118us) server_negotiation.cc:407] Connection header received
0811 04:48:26.682919 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.682925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.682993 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.683081 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.683399 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.684210 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.685386 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.686010 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.686104 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.686148 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.686367 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.686425 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:48:26.686581 20391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.682433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.17.188.66:51297)
0811 04:48:26.682676 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.682693 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.682806 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.683113 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.683118 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.683138 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.683274 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.683280 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.684316 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.684319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.685261 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.685270 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.686129 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.686133 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.686240 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.686265 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.686346 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.686415 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132}
I20260811 04:48:26.687153 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.682522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:55811 (local address 127.17.188.65:46429)
0811 04:48:26.682651 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.682656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.683031 (+ 375us) server_negotiation.cc:407] Connection header received
0811 04:48:26.683147 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.683150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.683198 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.683278 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.684039 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.684707 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.685884 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.686444 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.686547 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.686627 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.686968 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.687045 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:48:26.687170 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.682433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:46429 (local address 127.17.188.66:55811)
0811 04:48:26.682916 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.682930 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.683046 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.683307 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.683310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.683343 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.683919 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.683929 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.684825 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.684828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.685759 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.685770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.686567 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.686574 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.686843 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.686867 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.686950 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.687020 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"mutex_wait_us":51,"thread_start_us":150,"threads_started":1}
I20260811 04:48:26.687321 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01d8b2f605b49c0a0917103f99354c9" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d" is_pre_election: true
I20260811 04:48:26.687703 20617 raft_consensus.cc:2454] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 0.
I20260811 04:48:26.687893 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01d8b2f605b49c0a0917103f99354c9" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3" is_pre_election: true
I20260811 04:48:26.688189 20297 raft_consensus.cc:2454] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 0.
I20260811 04:48:26.688222 20383 leader_election.cc:302] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1022be82d954d8ba0e3fcfe915d164d, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:26.688488 20702 raft_consensus.cc:2781] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:26.688575 20702 raft_consensus.cc:482] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:26.688676 20702 raft_consensus.cc:3037] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.689881 20702 raft_consensus.cc:504] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.690232 20702 leader_election.cc:288] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 election: Requested vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:26.690567 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01d8b2f605b49c0a0917103f99354c9" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d"
I20260811 04:48:26.690546 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01d8b2f605b49c0a0917103f99354c9" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3"
I20260811 04:48:26.690665 20617 raft_consensus.cc:3037] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.690702 20297 raft_consensus.cc:3037] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.691708 20297 raft_consensus.cc:2454] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 1.
I20260811 04:48:26.691788 20617 raft_consensus.cc:2454] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 1.
I20260811 04:48:26.692027 20384 leader_election.cc:302] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:26.692224 20702 raft_consensus.cc:2781] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:26.692466 20702 raft_consensus.cc:686] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Running, Role: LEADER
I20260811 04:48:26.692811 20702 consensus_queue.cc:237] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.696302 20118 catalog_manager.cc:5495] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9e42b144f5486baded5720375b1da4 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "fe9e42b144f5486baded5720375b1da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } health_report { overall_health: UNKNOWN } } }
Aug 11 04:48:26 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423705, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:26.751351 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.743299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55626 (local address 127.17.188.126:41457)
0811 04:48:26.743449 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.743454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.743687 (+ 233us) server_negotiation.cc:407] Connection header received
0811 04:48:26.743819 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.743823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.743863 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.743951 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:26.744655 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.745169 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.745981 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.746183 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.746289 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.748550 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:26.748553 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:26.748555 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:26.748579 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:26.749857 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.750288 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.750290 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.750292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.750365 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:26.750595 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:26.750597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:26.750598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:26.750769 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:26.750840 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.751106 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.751229 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":45}
I20260811 04:48:26.751350 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.743257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41457 (local address 127.0.0.1:55626)
0811 04:48:26.743580 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.743593 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.743728 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.743969 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.743972 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.744440 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:26.744528 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.744534 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.745287 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.745293 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.745863 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.745871 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.746291 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.746294 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.746372 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.746892 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:26.746904 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:26.748417 (+ 1513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:26.749962 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.749970 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.749975 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.750200 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.750443 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:26.750445 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:26.750446 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:26.750522 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:26.750856 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:26.750861 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:26.750964 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.751052 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.751173 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":118,"threads_started":1}
I20260811 04:48:26.755344 20118 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:55626:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 04:48:26.756192 20118 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:26.761307 20276 tablet_service.cc:1467] Processing CreateTablet for tablet 41fbfd5b211841e3891f9143d82eb2cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e70a2e04834e409283c57a84974f9fb9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:26.761307 20422 tablet_service.cc:1467] Processing CreateTablet for tablet 41fbfd5b211841e3891f9143d82eb2cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e70a2e04834e409283c57a84974f9fb9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:26.762145 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41fbfd5b211841e3891f9143d82eb2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.762145 20276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41fbfd5b211841e3891f9143d82eb2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.761895 20597 tablet_service.cc:1467] Processing CreateTablet for tablet 41fbfd5b211841e3891f9143d82eb2cf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=e70a2e04834e409283c57a84974f9fb9]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:26.762616 20597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41fbfd5b211841e3891f9143d82eb2cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:26.765259 20696 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: Bootstrap starting.
I20260811 04:48:26.765304 20694 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: Bootstrap starting.
I20260811 04:48:26.765480 20697 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: Bootstrap starting.
I20260811 04:48:26.766474 20696 tablet_bootstrap.cc:654] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.766574 20694 tablet_bootstrap.cc:654] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.766574 20697 tablet_bootstrap.cc:654] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:26.767843 20696 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: No bootstrap required, opened a new log
I20260811 04:48:26.767952 20696 ts_tablet_manager.cc:1397] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:26.767998 20697 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: No bootstrap required, opened a new log
I20260811 04:48:26.767998 20694 tablet_bootstrap.cc:492] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: No bootstrap required, opened a new log
I20260811 04:48:26.768087 20697 ts_tablet_manager.cc:1397] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:26.768087 20694 ts_tablet_manager.cc:1397] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:26.768394 20696 raft_consensus.cc:348] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.768512 20696 raft_consensus.cc:374] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.768553 20696 raft_consensus.cc:729] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.768544 20697 raft_consensus.cc:348] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.768544 20694 raft_consensus.cc:348] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.768662 20697 raft_consensus.cc:374] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.768674 20694 raft_consensus.cc:374] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:26.768711 20694 raft_consensus.cc:729] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.768711 20697 raft_consensus.cc:729] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Initialized, Role: FOLLOWER
I20260811 04:48:26.768705 20696 consensus_queue.cc:260] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.768842 20694 consensus_queue.cc:260] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.768842 20697 consensus_queue.cc:260] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.769024 20696 ts_tablet_manager.cc:1428] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:26.769107 20694 ts_tablet_manager.cc:1428] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:26.769107 20697 ts_tablet_manager.cc:1428] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:26.769351 20702 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.769338 20703 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.769476 20703 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.769476 20702 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.769714 20700 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.769855 20700 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260811 04:48:26.810863 20670 tablet.cc:2369] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:48:26.838275 20515 tablet.cc:2369] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:48:26.861030 20354 tablet.cc:2369] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:26.896101 20703 raft_consensus.cc:482] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:26.896236 20703 raft_consensus.cc:504] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.897333 20703 leader_election.cc:288] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:26.901088 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.897574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:46429 (local address 127.17.188.67:56377)
0811 04:48:26.897723 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.897738 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.897831 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.898107 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.898110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.898133 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.898255 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.898262 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.899036 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.899039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.899928 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.899938 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.900630 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.900744 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.900768 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.900846 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.900923 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":45}
I20260811 04:48:26.901098 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.897694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56377 (local address 127.17.188.65:46429)
0811 04:48:26.897830 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.897834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.897852 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:48:26.897932 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.897935 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.897982 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.898075 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.898376 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.898925 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900059 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.900489 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900587 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.900625 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.900888 (+ 263us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.900967 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:48:26.901142 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.897726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:35545 (local address 127.17.188.66:38019)
0811 04:48:26.897844 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.897848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.898126 (+ 278us) server_negotiation.cc:407] Connection header received
0811 04:48:26.898210 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.898215 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.898266 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.898341 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:26.898612 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.899133 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900185 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.900593 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900710 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.900759 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.900949 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.901029 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:26.901144 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.897578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38019 (local address 127.17.188.67:35545)
0811 04:48:26.898018 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.898031 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.898124 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.898371 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.898374 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.898390 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:26.898502 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.898507 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.899241 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.899243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.900061 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.900070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.900730 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.900733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.900806 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.900823 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.900920 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.900979 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":3,"thread_start_us":125,"threads_started":1}
I20260811 04:48:26.901597 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41fbfd5b211841e3891f9143d82eb2cf" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3" is_pre_election: true
I20260811 04:48:26.901772 20297 raft_consensus.cc:2454] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 0.
I20260811 04:48:26.901774 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41fbfd5b211841e3891f9143d82eb2cf" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4" is_pre_election: true
I20260811 04:48:26.902067 20463 raft_consensus.cc:2454] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 0.
I20260811 04:48:26.902207 20542 leader_election.cc:302] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, d1022be82d954d8ba0e3fcfe915d164d; no voters:
I20260811 04:48:26.902501 20703 raft_consensus.cc:2781] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:26.902576 20703 raft_consensus.cc:482] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:26.902616 20703 raft_consensus.cc:3037] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.903671 20703 raft_consensus.cc:504] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.904063 20703 leader_election.cc:288] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 election: Requested vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:26.904383 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41fbfd5b211841e3891f9143d82eb2cf" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3"
I20260811 04:48:26.904531 20297 raft_consensus.cc:3037] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.904536 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41fbfd5b211841e3891f9143d82eb2cf" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4"
I20260811 04:48:26.904700 20463 raft_consensus.cc:3037] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:26.905494 20297 raft_consensus.cc:2454] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 1.
I20260811 04:48:26.905707 20463 raft_consensus.cc:2454] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 1.
I20260811 04:48:26.905825 20542 leader_election.cc:302] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, d1022be82d954d8ba0e3fcfe915d164d; no voters:
I20260811 04:48:26.906038 20703 raft_consensus.cc:2781] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:26.906219 20703 raft_consensus.cc:686] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [term 1 LEADER]: Becoming Leader. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Running, Role: LEADER
I20260811 04:48:26.906526 20703 consensus_queue.cc:237] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:26.908667 20717 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: TxnStatusTablet state changed. Reason: New leader d1022be82d954d8ba0e3fcfe915d164d. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.908789 20717 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:26.909061 20719 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 04:48:26.909263 20719 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 04:48:26.909797 20117 catalog_manager.cc:5495] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d reported cstate change: term changed from 0 to 1, leader changed from <none> to d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67). New cstate: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:26.927556 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.923477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.0.0.1:49106)
0811 04:48:26.923751 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.923766 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.923904 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.924238 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.924240 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.924248 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:26.924363 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.924368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.925083 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.925088 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.925792 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.925801 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.926239 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.926243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.926351 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.926395 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.927244 (+ 849us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.927263 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.927334 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.927442 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260811 04:48:26.927577 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.923566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49106 (local address 127.17.188.67:42263)
0811 04:48:26.923723 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.923728 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.923837 (+ 109us) server_negotiation.cc:407] Connection header received
0811 04:48:26.924051 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.924055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.924117 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.924209 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:26.924469 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.924969 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.925911 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.926131 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.926238 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.926544 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.926969 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.927267 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.927355 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.927412 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:48:26.933290 20297 raft_consensus.cc:1261] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Refusing update from remote peer d1022be82d954d8ba0e3fcfe915d164d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:26.933346 20463 raft_consensus.cc:1261] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Refusing update from remote peer d1022be82d954d8ba0e3fcfe915d164d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:26.934072 20717 consensus_queue.cc:1035] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:26.934281 20703 consensus_queue.cc:1035] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:26.938107 20702 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: TxnStatusTablet state changed. Reason: New leader d1022be82d954d8ba0e3fcfe915d164d. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.938234 20702 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.939697 20717 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.939821 20717 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:26.939996 20700 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: TxnStatusTablet state changed. Reason: New leader d1022be82d954d8ba0e3fcfe915d164d. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.940124 20700 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.940982 20722 mvcc.cc:205] Tried to move back new op lower bound from 7317191503592067072 to 7317191503491485696. Current Snapshot: MvccSnapshot[applied={T|T < 7317191503592067072 or (T in {7317191503592067072})}]
I20260811 04:48:26.941707 20717 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.941805 20717 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P d1022be82d954d8ba0e3fcfe915d164d: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:26.942857 20702 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.942977 20702 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P fe9e42b144f5486baded5720375b1da4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.943259 20724 mvcc.cc:205] Tried to move back new op lower bound from 7317191503592067072 to 7317191503491485696. Current Snapshot: MvccSnapshot[applied={T|T < 7317191503592067072}]
I20260811 04:48:26.945004 20700 tablet_replica.cc:439] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } } }
I20260811 04:48:26.945127 20700 tablet_replica.cc:442] T 41fbfd5b211841e3891f9143d82eb2cf P 64e2f36339d640e1b7b05351ecbd01e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:26.949164 20723 mvcc.cc:205] Tried to move back new op lower bound from 7317191503592067072 to 7317191503491485696. Current Snapshot: MvccSnapshot[applied={T|T < 7317191503592067072}]
I20260811 04:48:26.953964 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.950014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39424 (local address 127.17.188.66:38019)
0811 04:48:26.950147 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.950152 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.950225 (+ 73us) server_negotiation.cc:407] Connection header received
0811 04:48:26.950440 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.950444 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.950499 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.950600 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:26.950855 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.951611 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.952459 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.952796 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.952899 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.953146 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.953625 (+ 479us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.953724 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.953787 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.953837 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:48:26.964704 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.961065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:45809 (local address 127.17.188.67:42263)
0811 04:48:26.961187 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.961191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.961341 (+ 150us) server_negotiation.cc:407] Connection header received
0811 04:48:26.961423 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.961426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.961475 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.961600 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:26.961841 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.962578 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.963476 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.963821 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.963923 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.964253 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.964331 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.964418 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.964523 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.964573 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:48:26.964716 20737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.960965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.17.188.66:45809)
0811 04:48:26.961260 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.961273 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.961357 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.961634 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.961636 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.961642 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:26.961739 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.961743 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.962674 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.962676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.963281 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.963312 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.963964 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.963967 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.964054 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.964097 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.964438 (+ 341us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.964446 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.964511 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.964572 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":107,"threads_started":1}
I20260811 04:48:26.972674 20297 raft_consensus.cc:1261] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Refusing update from remote peer fe9e42b144f5486baded5720375b1da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:26.972725 20617 raft_consensus.cc:1261] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Refusing update from remote peer fe9e42b144f5486baded5720375b1da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:26.973110 20705 consensus_queue.cc:1035] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:26.973351 20702 consensus_queue.cc:1035] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:26.996407 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.992560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:48675 (local address 127.17.188.66:38019)
0811 04:48:26.992681 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:26.992687 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:26.992767 (+ 80us) server_negotiation.cc:407] Connection header received
0811 04:48:26.992917 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:26.992920 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:26.992978 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:26.993092 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:26.993450 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.994191 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.995395 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.995674 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.995766 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.996052 (+ 286us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.996112 (+ 60us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.996161 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:26.996270 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 04:48:26.996310 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:48:26.996464 20675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:26.992457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38019 (local address 127.17.188.67:48675)
0811 04:48:26.992713 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:26.992726 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:26.992804 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:26.993200 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:26.993203 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:26.993210 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:26.993322 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.993329 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.994297 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.994301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.995279 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:26.995290 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:26.995790 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:26.995793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:26.995891 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:26.995941 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:26.996187 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:26.996193 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 04:48:26.996265 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 04:48:26.996337 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260811 04:48:27.018013 20118 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:27.018229 20118 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:27.020812 20118 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Sending DeleteTablet for 3 replicas of tablet b01d8b2f605b49c0a0917103f99354c9
I20260811 04:48:27.021526 20422 tablet_service.cc:1514] Processing DeleteTablet for tablet b01d8b2f605b49c0a0917103f99354c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:27 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:39422
I20260811 04:48:27.021768 20597 tablet_service.cc:1514] Processing DeleteTablet for tablet b01d8b2f605b49c0a0917103f99354c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:27 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49094
I20260811 04:48:27.022260 20745 tablet_replica.cc:330] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: stopping tablet replica
I20260811 04:48:27.022500 20746 tablet_replica.cc:330] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: stopping tablet replica
I20260811 04:48:27.022540 20276 tablet_service.cc:1514] Processing DeleteTablet for tablet b01d8b2f605b49c0a0917103f99354c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:27 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58354
I20260811 04:48:27.022993 20745 raft_consensus.cc:2229] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:27.023276 20746 raft_consensus.cc:2229] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:27.023519 20746 raft_consensus.cc:2258] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:27.023782 20118 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:27.024269 20118 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:27.024426 20745 raft_consensus.cc:2258] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:27.026034 20745 ts_tablet_manager.cc:1905] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:27.029554 20745 ts_tablet_manager.cc:1918] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:27.029749 20745 log.cc:1196] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/b01d8b2f605b49c0a0917103f99354c9
I20260811 04:48:27.029923 20422 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 (DEFAULT_TABLE table=test-table [id=1291aea456b84725a1052e2073c9bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:27.030194 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe6a519ee0446c8a880e222a9d86bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:27.030412 20745 ts_tablet_manager.cc:1939] T b01d8b2f605b49c0a0917103f99354c9 P fe9e42b144f5486baded5720375b1da4: Deleting consensus metadata
I20260811 04:48:27.031648 20103 catalog_manager.cc:4841] TS fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019): tablet b01d8b2f605b49c0a0917103f99354c9 (table test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]) successfully deleted
I20260811 04:48:27.032327 20696 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Bootstrap starting.
I20260811 04:48:27.032677 20597 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 (DEFAULT_TABLE table=test-table [id=1291aea456b84725a1052e2073c9bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:27.032931 20597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe6a519ee0446c8a880e222a9d86bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:27.033227 20696 tablet_bootstrap.cc:654] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:27.034826 20696 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: No bootstrap required, opened a new log
I20260811 04:48:27.034909 20696 ts_tablet_manager.cc:1397] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:27.035449 20696 raft_consensus.cc:348] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.035665 20696 raft_consensus.cc:374] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:27.035722 20696 raft_consensus.cc:729] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Initialized, Role: FOLLOWER
I20260811 04:48:27.035910 20696 consensus_queue.cc:260] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.036007 20276 tablet_service.cc:1467] Processing CreateTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 (DEFAULT_TABLE table=test-table [id=1291aea456b84725a1052e2073c9bcc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:27.036156 20696 ts_tablet_manager.cc:1428] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:27.036295 20276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2fe6a519ee0446c8a880e222a9d86bf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:27.038820 20694 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Bootstrap starting.
I20260811 04:48:27.039117 20697 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Bootstrap starting.
I20260811 04:48:27.040607 20697 tablet_bootstrap.cc:654] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:27.040659 20694 tablet_bootstrap.cc:654] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:27.043056 20697 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: No bootstrap required, opened a new log
I20260811 04:48:27.043196 20697 ts_tablet_manager.cc:1397] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s
I20260811 04:48:27.044440 20747 tablet_replica.cc:330] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: stopping tablet replica
I20260811 04:48:27.044775 20747 raft_consensus.cc:2229] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:27.044966 20746 ts_tablet_manager.cc:1905] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:27.045024 20747 raft_consensus.cc:2258] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:27.047422 20747 ts_tablet_manager.cc:1905] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:27.048506 20746 ts_tablet_manager.cc:1918] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:27.048586 20746 log.cc:1196] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/b01d8b2f605b49c0a0917103f99354c9
I20260811 04:48:27.049049 20746 ts_tablet_manager.cc:1939] T b01d8b2f605b49c0a0917103f99354c9 P d1022be82d954d8ba0e3fcfe915d164d: Deleting consensus metadata
I20260811 04:48:27.049963 20697 raft_consensus.cc:348] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.050133 20697 raft_consensus.cc:374] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:27.050210 20697 raft_consensus.cc:729] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Initialized, Role: FOLLOWER
I20260811 04:48:27.050408 20697 consensus_queue.cc:260] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.051290 20697 ts_tablet_manager.cc:1428] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20260811 04:48:27.052187 20103 catalog_manager.cc:4841] TS d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263): tablet b01d8b2f605b49c0a0917103f99354c9 (table test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]) successfully deleted
I20260811 04:48:27.052778 20694 tablet_bootstrap.cc:492] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: No bootstrap required, opened a new log
I20260811 04:48:27.052870 20694 ts_tablet_manager.cc:1397] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.003s
I20260811 04:48:27.053400 20694 raft_consensus.cc:348] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.053508 20694 raft_consensus.cc:374] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:27.053542 20694 raft_consensus.cc:729] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Initialized, Role: FOLLOWER
I20260811 04:48:27.053694 20694 consensus_queue.cc:260] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.053962 20694 ts_tablet_manager.cc:1428] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:27.057267 20747 ts_tablet_manager.cc:1918] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:27.057379 20747 log.cc:1196] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/b01d8b2f605b49c0a0917103f99354c9
I20260811 04:48:27.057746 20747 ts_tablet_manager.cc:1939] T b01d8b2f605b49c0a0917103f99354c9 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting consensus metadata
I20260811 04:48:27.059233 20104 catalog_manager.cc:4841] TS 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429): tablet b01d8b2f605b49c0a0917103f99354c9 (table test-table [id=3630f76de6a74b399fb3cfdfbde7a0ff]) successfully deleted
I20260811 04:48:27.173133 20702 raft_consensus.cc:482] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:27.173333 20702 raft_consensus.cc:504] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.173996 20702 leader_election.cc:288] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:27.174376 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe6a519ee0446c8a880e222a9d86bf2" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3" is_pre_election: true
I20260811 04:48:27.174376 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe6a519ee0446c8a880e222a9d86bf2" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d" is_pre_election: true
I20260811 04:48:27.174533 20297 raft_consensus.cc:2454] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 0.
I20260811 04:48:27.174533 20617 raft_consensus.cc:2454] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 0.
I20260811 04:48:27.174882 20383 leader_election.cc:302] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1022be82d954d8ba0e3fcfe915d164d, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:27.175074 20702 raft_consensus.cc:2781] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:27.175150 20702 raft_consensus.cc:482] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:27.175182 20702 raft_consensus.cc:3037] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:27.176877 20702 raft_consensus.cc:504] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.177245 20702 leader_election.cc:288] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 election: Requested vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:27.177629 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe6a519ee0446c8a880e222a9d86bf2" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d"
I20260811 04:48:27.177695 20297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2fe6a519ee0446c8a880e222a9d86bf2" candidate_uuid: "fe9e42b144f5486baded5720375b1da4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3"
I20260811 04:48:27.177768 20617 raft_consensus.cc:3037] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:27.177867 20297 raft_consensus.cc:3037] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:27.178745 20617 raft_consensus.cc:2454] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 1.
I20260811 04:48:27.179041 20383 leader_election.cc:302] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1022be82d954d8ba0e3fcfe915d164d, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:27.179226 20702 raft_consensus.cc:2781] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:27.179348 20702 raft_consensus.cc:686] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 1 LEADER]: Becoming Leader. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Running, Role: LEADER
I20260811 04:48:27.179399 20297 raft_consensus.cc:2454] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fe9e42b144f5486baded5720375b1da4 in term 1.
I20260811 04:48:27.179481 20702 consensus_queue.cc:237] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:27.181216 20118 catalog_manager.cc:5495] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 reported cstate change: term changed from 0 to 1, leader changed from <none> to fe9e42b144f5486baded5720375b1da4 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "fe9e42b144f5486baded5720375b1da4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } health_report { overall_health: UNKNOWN } } }
I20260811 04:48:27.219241 20297 raft_consensus.cc:1261] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Refusing update from remote peer fe9e42b144f5486baded5720375b1da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:27.219250 20617 raft_consensus.cc:1261] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Refusing update from remote peer fe9e42b144f5486baded5720375b1da4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:27.219627 20705 consensus_queue.cc:1035] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:27.219812 20702 consensus_queue.cc:1035] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 04:48:27.235536 20723 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 04:48:28.793485 20117 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:28.793722 20117 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55622:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:28.796001 20117 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Sending DeleteTablet for 3 replicas of tablet 2fe6a519ee0446c8a880e222a9d86bf2
I20260811 04:48:28.796509 20276 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58354
I20260811 04:48:28.796577 20597 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49094
I20260811 04:48:28.796803 20422 tablet_service.cc:1514] Processing DeleteTablet for tablet 2fe6a519ee0446c8a880e222a9d86bf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:39422
I20260811 04:48:28.796897 20783 tablet_replica.cc:330] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: stopping tablet replica
I20260811 04:48:28.796875 20782 tablet_replica.cc:330] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: stopping tablet replica
I20260811 04:48:28.797046 20783 raft_consensus.cc:2229] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:28.797132 20782 raft_consensus.cc:2229] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:28.797147 20783 raft_consensus.cc:2258] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.797232 20782 raft_consensus.cc:2258] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.797822 20783 ts_tablet_manager.cc:1905] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.797822 20782 ts_tablet_manager.cc:1905] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.800405 20783 ts_tablet_manager.cc:1918] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 04:48:28.800405 20782 ts_tablet_manager.cc:1918] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 04:48:28.800485 20782 log.cc:1196] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/2fe6a519ee0446c8a880e222a9d86bf2
I20260811 04:48:28.800485 20783 log.cc:1196] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/2fe6a519ee0446c8a880e222a9d86bf2
I20260811 04:48:28.800760 20782 ts_tablet_manager.cc:1939] T 2fe6a519ee0446c8a880e222a9d86bf2 P 64e2f36339d640e1b7b05351ecbd01e3: Deleting consensus metadata
I20260811 04:48:28.800760 20783 ts_tablet_manager.cc:1939] T 2fe6a519ee0446c8a880e222a9d86bf2 P d1022be82d954d8ba0e3fcfe915d164d: Deleting consensus metadata
I20260811 04:48:28.801486 20103 catalog_manager.cc:4841] TS d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263): tablet 2fe6a519ee0446c8a880e222a9d86bf2 (table test-table [id=1291aea456b84725a1052e2073c9bcc9]) successfully deleted
I20260811 04:48:28.802085 20784 tablet_replica.cc:330] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: stopping tablet replica
I20260811 04:48:28.802347 20784 raft_consensus.cc:2229] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:28.802544 20104 catalog_manager.cc:4841] TS 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429): tablet 2fe6a519ee0446c8a880e222a9d86bf2 (table test-table [id=1291aea456b84725a1052e2073c9bcc9]) successfully deleted
I20260811 04:48:28.802591 20784 raft_consensus.cc:2258] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.803130 20784 ts_tablet_manager.cc:1905] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.805394 20784 ts_tablet_manager.cc:1918] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 04:48:28.805485 20784 log.cc:1196] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/2fe6a519ee0446c8a880e222a9d86bf2
I20260811 04:48:28.805819 20784 ts_tablet_manager.cc:1939] T 2fe6a519ee0446c8a880e222a9d86bf2 P fe9e42b144f5486baded5720375b1da4: Deleting consensus metadata
I20260811 04:48:28.806463 20103 catalog_manager.cc:4841] TS fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019): tablet 2fe6a519ee0446c8a880e222a9d86bf2 (table test-table [id=1291aea456b84725a1052e2073c9bcc9]) successfully deleted
Aug 11 04:48:28 dist-test-slave-njxd krb5kdc[20074](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 04:48:28 dist-test-slave-njxd krb5kdc[20074](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423708, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:28.828472 20793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.820074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55638 (local address 127.17.188.126:41457)
0811 04:48:28.820427 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.820455 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.820469 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:28.820563 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.820569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.820640 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.820726 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:28.821342 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.821941 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.822719 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.822923 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.822994 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.825303 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:28.825306 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:28.825308 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:28.825330 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:28.826779 (+ 1449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:28.827223 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:28.827227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:28.827228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:28.827306 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:28.827589 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:28.827593 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:28.827595 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:28.827776 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:28.827918 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.828148 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.828285 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":120,"threads_started":1}
I20260811 04:48:28.831035 20117 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:28.831441 20117 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:28.835994 20276 tablet_service.cc:1467] Processing CreateTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (DEFAULT_TABLE table=test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.836133 20422 tablet_service.cc:1467] Processing CreateTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (DEFAULT_TABLE table=test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.836335 20276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.836436 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.837932 20597 tablet_service.cc:1467] Processing CreateTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (DEFAULT_TABLE table=test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.838248 20597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.838917 20794 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Bootstrap starting.
I20260811 04:48:28.839669 20794 tablet_bootstrap.cc:654] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.840474 20797 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Bootstrap starting.
I20260811 04:48:28.841384 20797 tablet_bootstrap.cc:654] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.842465 20797 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: No bootstrap required, opened a new log
I20260811 04:48:28.842547 20797 ts_tablet_manager.cc:1397] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:28.842901 20797 raft_consensus.cc:348] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.843004 20797 raft_consensus.cc:374] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.843031 20797 raft_consensus.cc:729] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.843153 20797 consensus_queue.cc:260] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.843389 20797 ts_tablet_manager.cc:1428] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:28.845412 20775 raft_consensus.cc:482] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:28.845511 20775 raft_consensus.cc:504] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.845903 20775 leader_election.cc:288] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:28.846079 20795 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Bootstrap starting.
I20260811 04:48:28.846452 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3" is_pre_election: true
I20260811 04:48:28.847007 20795 tablet_bootstrap.cc:654] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.847211 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4" is_pre_election: true
W20260811 04:48:28.847319 20542 leader_election.cc:341] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429): Illegal state: must be running to vote when last-logged opid is not known
W20260811 04:48:28.847699 20541 leader_election.cc:341] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019): Illegal state: must be running to vote when last-logged opid is not known
I20260811 04:48:28.847791 20541 leader_election.cc:302] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1022be82d954d8ba0e3fcfe915d164d; no voters: 64e2f36339d640e1b7b05351ecbd01e3, fe9e42b144f5486baded5720375b1da4
I20260811 04:48:28.848011 20775 raft_consensus.cc:2726] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 04:48:28.848662 20795 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: No bootstrap required, opened a new log
I20260811 04:48:28.848750 20795 ts_tablet_manager.cc:1397] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:28.849187 20795 raft_consensus.cc:348] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.849300 20795 raft_consensus.cc:374] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.849323 20795 raft_consensus.cc:729] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.849462 20795 consensus_queue.cc:260] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.849802 20795 ts_tablet_manager.cc:1428] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 04:48:28.850360 20794 tablet_bootstrap.cc:492] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: No bootstrap required, opened a new log
I20260811 04:48:28.850458 20794 ts_tablet_manager.cc:1397] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260811 04:48:28.850986 20794 raft_consensus.cc:348] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.851115 20794 raft_consensus.cc:374] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.851155 20794 raft_consensus.cc:729] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.851292 20794 consensus_queue.cc:260] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.851702 20794 ts_tablet_manager.cc:1428] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:28.859550 20801 raft_consensus.cc:482] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:28.859647 20801 raft_consensus.cc:504] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.860700 20801 leader_election.cc:288] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:28.866303 20802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.860897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38019 (local address 127.17.188.65:41725)
0811 04:48:28.861507 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:28.861521 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:28.861715 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:28.862001 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:28.862003 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:28.862013 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:28.862159 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.862166 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.863196 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.863199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.864891 (+ 1692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.864902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.865809 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.865951 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.865985 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 04:48:28.866077 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 04:48:28.866153 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":74,"thread_start_us":203,"threads_started":1}
I20260811 04:48:28.866291 20803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.860962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:41725 (local address 127.17.188.66:38019)
0811 04:48:28.861278 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.861309 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.861809 (+ 500us) server_negotiation.cc:407] Connection header received
0811 04:48:28.861866 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.861869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.861913 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.862001 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:28.862281 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.863080 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865010 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.865699 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865803 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.865854 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.866098 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.866174 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":131,"threads_started":1}
I20260811 04:48:28.866645 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.861377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.17.188.65:56303)
0811 04:48:28.861743 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:28.861757 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:28.861875 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:28.862115 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:28.862120 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:28.862137 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:28.862383 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.862390 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.863442 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.863445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.864891 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.864902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.865917 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.866168 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.866192 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:28.866268 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 04:48:28.866359 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":64,"thread_start_us":186,"threads_started":1}
I20260811 04:48:28.866740 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "64e2f36339d640e1b7b05351ecbd01e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4" is_pre_election: true
I20260811 04:48:28.866885 20463 raft_consensus.cc:2454] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64e2f36339d640e1b7b05351ecbd01e3 in term 0.
I20260811 04:48:28.867033 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.861490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:56303 (local address 127.17.188.67:42263)
0811 04:48:28.861816 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.861825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.861843 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:48:28.861952 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.861958 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.862008 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.862087 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:28.862491 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.863239 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865010 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.865687 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.865803 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.865854 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.866813 (+ 959us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.866901 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":143,"threads_started":1}
I20260811 04:48:28.867291 20223 leader_election.cc:302] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:28.867434 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "64e2f36339d640e1b7b05351ecbd01e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d" is_pre_election: true
I20260811 04:48:28.867537 20801 raft_consensus.cc:2781] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:28.867586 20801 raft_consensus.cc:482] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:28.867578 20617 raft_consensus.cc:2454] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64e2f36339d640e1b7b05351ecbd01e3 in term 0.
I20260811 04:48:28.867624 20801 raft_consensus.cc:3037] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:28.869169 20801 raft_consensus.cc:504] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.869493 20801 leader_election.cc:288] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [CANDIDATE]: Term 1 election: Requested vote from peers fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019), d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263)
I20260811 04:48:28.869861 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "64e2f36339d640e1b7b05351ecbd01e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4"
I20260811 04:48:28.869918 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45d409ccbd7b4bb8b7dbf3c847d9145d" candidate_uuid: "64e2f36339d640e1b7b05351ecbd01e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d1022be82d954d8ba0e3fcfe915d164d"
I20260811 04:48:28.869999 20463 raft_consensus.cc:3037] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:28.870018 20617 raft_consensus.cc:3037] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:28.871196 20463 raft_consensus.cc:2454] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64e2f36339d640e1b7b05351ecbd01e3 in term 1.
I20260811 04:48:28.871196 20617 raft_consensus.cc:2454] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64e2f36339d640e1b7b05351ecbd01e3 in term 1.
I20260811 04:48:28.871454 20223 leader_election.cc:302] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:28.871629 20801 raft_consensus.cc:2781] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:28.871822 20801 raft_consensus.cc:686] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 LEADER]: Becoming Leader. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Running, Role: LEADER
I20260811 04:48:28.872077 20801 consensus_queue.cc:237] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.874322 20117 catalog_manager.cc:5495] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "64e2f36339d640e1b7b05351ecbd01e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } health_report { overall_health: UNKNOWN } } }
I20260811 04:48:28.896303 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.892550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58362 (local address 127.17.188.65:46429)
0811 04:48:28.892920 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.892943 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.892955 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:48:28.893016 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.893018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.893062 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.893184 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:28.893379 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.894043 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.894868 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.895185 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.895268 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.895486 (+ 218us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:28.895968 (+ 482us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:28.896051 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.896101 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.896151 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":178,"threads_started":1}
I20260811 04:48:28.906103 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.902696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:36101 (local address 127.17.188.67:42263)
0811 04:48:28.902817 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.902820 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.903052 (+ 232us) server_negotiation.cc:407] Connection header received
0811 04:48:28.903214 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.903217 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.903261 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.903331 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:28.903633 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.904103 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.905027 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.905253 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.905356 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.905672 (+ 316us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:28.905739 (+ 67us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:28.905811 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.905922 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.905968 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:48:28.906121 20812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.902591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.17.188.65:36101)
0811 04:48:28.902980 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:28.902992 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:28.903084 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:28.903347 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:28.903348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:28.903355 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:28.903497 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.903505 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.904231 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.904237 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.904911 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.904920 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.905358 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.905361 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.905462 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.905499 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:28.905827 (+ 328us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:28.905834 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 04:48:28.905908 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:48:28.905978 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":164,"threads_started":1}
I20260811 04:48:28.911373 20463 raft_consensus.cc:1261] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Refusing update from remote peer 64e2f36339d640e1b7b05351ecbd01e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:28.911373 20617 raft_consensus.cc:1261] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Refusing update from remote peer 64e2f36339d640e1b7b05351ecbd01e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:28.911864 20806 consensus_queue.cc:1035] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:28.912113 20801 consensus_queue.cc:1035] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:28.929342 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.926144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:53131 (local address 127.17.188.65:46429)
0811 04:48:28.926282 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:28.926289 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:28.926540 (+ 251us) server_negotiation.cc:407] Connection header received
0811 04:48:28.926680 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:28.926683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:28.926720 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:28.926776 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:28.926926 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.927378 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.928263 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.928538 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.928650 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.928904 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:28.928979 (+ 75us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:28.929056 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:28.929155 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 04:48:28.929216 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:28.929399 20817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:28.926101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:46429 (local address 127.17.188.67:53131)
0811 04:48:28.926451 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:28.926465 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:28.926592 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:28.926784 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:28.926786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:28.926791 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:28.926866 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.926870 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.927456 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.927459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.928174 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:28.928184 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:28.928664 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:28.928669 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:28.928751 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:28.928785 (+ 34us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:28.929069 (+ 284us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:28.929077 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:48:28.929144 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 04:48:28.929232 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":159,"threads_started":1}
I20260811 04:48:28.951952 20118 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:28.952131 20118 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:28.954109 20118 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Sending DeleteTablet for 3 replicas of tablet 45d409ccbd7b4bb8b7dbf3c847d9145d
I20260811 04:48:28.954762 20276 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58354
I20260811 04:48:28.954860 20597 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49094
I20260811 04:48:28.954939 20782 tablet_replica.cc:330] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: stopping tablet replica
I20260811 04:48:28.955004 20783 tablet_replica.cc:330] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: stopping tablet replica
I20260811 04:48:28.954946 20422 tablet_service.cc:1514] Processing DeleteTablet for tablet 45d409ccbd7b4bb8b7dbf3c847d9145d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:28 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:39422
I20260811 04:48:28.955050 20782 raft_consensus.cc:2229] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:28.955101 20783 raft_consensus.cc:2229] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:28.955150 20784 tablet_replica.cc:330] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: stopping tablet replica
I20260811 04:48:28.955194 20783 raft_consensus.cc:2258] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.955257 20784 raft_consensus.cc:2229] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:28.955353 20782 raft_consensus.cc:2258] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.955410 20784 raft_consensus.cc:2258] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:28.956099 20783 ts_tablet_manager.cc:1905] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.956115 20782 ts_tablet_manager.cc:1905] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.956225 20784 ts_tablet_manager.cc:1905] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:28.958896 20783 ts_tablet_manager.cc:1918] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:28.958937 20784 ts_tablet_manager.cc:1918] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:28.958937 20782 ts_tablet_manager.cc:1918] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:28.958964 20783 log.cc:1196] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/45d409ccbd7b4bb8b7dbf3c847d9145d
I20260811 04:48:28.959007 20782 log.cc:1196] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/45d409ccbd7b4bb8b7dbf3c847d9145d
I20260811 04:48:28.959007 20784 log.cc:1196] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/45d409ccbd7b4bb8b7dbf3c847d9145d
I20260811 04:48:28.959260 20783 ts_tablet_manager.cc:1939] T 45d409ccbd7b4bb8b7dbf3c847d9145d P d1022be82d954d8ba0e3fcfe915d164d: Deleting consensus metadata
I20260811 04:48:28.959302 20784 ts_tablet_manager.cc:1939] T 45d409ccbd7b4bb8b7dbf3c847d9145d P fe9e42b144f5486baded5720375b1da4: Deleting consensus metadata
I20260811 04:48:28.959311 20782 ts_tablet_manager.cc:1939] T 45d409ccbd7b4bb8b7dbf3c847d9145d P 64e2f36339d640e1b7b05351ecbd01e3: Deleting consensus metadata
I20260811 04:48:28.959908 20104 catalog_manager.cc:4841] TS 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429): tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (table test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]) successfully deleted
I20260811 04:48:28.959923 20103 catalog_manager.cc:4841] TS fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019): tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (table test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]) successfully deleted
I20260811 04:48:28.960219 20103 catalog_manager.cc:4841] TS d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263): tablet 45d409ccbd7b4bb8b7dbf3c847d9145d (table test-table [id=0c18c6c7c8cf4c04afedfd89ccd76c19]) successfully deleted
I20260811 04:48:28.961009 20118 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:28.961409 20118 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:28.965922 20276 tablet_service.cc:1467] Processing CreateTablet for tablet fc971c823864472fb3244b19267acfb8 (DEFAULT_TABLE table=test-table [id=13725dbe1433402dae12a8bb443448d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.966194 20276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc971c823864472fb3244b19267acfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.966238 20422 tablet_service.cc:1467] Processing CreateTablet for tablet fc971c823864472fb3244b19267acfb8 (DEFAULT_TABLE table=test-table [id=13725dbe1433402dae12a8bb443448d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.966507 20422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc971c823864472fb3244b19267acfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.966602 20597 tablet_service.cc:1467] Processing CreateTablet for tablet fc971c823864472fb3244b19267acfb8 (DEFAULT_TABLE table=test-table [id=13725dbe1433402dae12a8bb443448d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:28.966835 20597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc971c823864472fb3244b19267acfb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:28.968842 20794 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: Bootstrap starting.
I20260811 04:48:28.968997 20795 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Bootstrap starting.
I20260811 04:48:28.969062 20797 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Bootstrap starting.
I20260811 04:48:28.969847 20795 tablet_bootstrap.cc:654] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.970319 20797 tablet_bootstrap.cc:654] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.970645 20794 tablet_bootstrap.cc:654] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:28.971524 20795 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: No bootstrap required, opened a new log
I20260811 04:48:28.971624 20795 ts_tablet_manager.cc:1397] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260811 04:48:28.971979 20795 raft_consensus.cc:348] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.972090 20795 raft_consensus.cc:374] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.972117 20795 raft_consensus.cc:729] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe9e42b144f5486baded5720375b1da4, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.972240 20795 consensus_queue.cc:260] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.972573 20795 ts_tablet_manager.cc:1428] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260811 04:48:28.972594 20794 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: No bootstrap required, opened a new log
I20260811 04:48:28.972676 20794 ts_tablet_manager.cc:1397] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 04:48:28.973362 20797 tablet_bootstrap.cc:492] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: No bootstrap required, opened a new log
I20260811 04:48:28.973371 20794 raft_consensus.cc:348] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.973449 20797 ts_tablet_manager.cc:1397] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 04:48:28.973470 20794 raft_consensus.cc:374] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.973501 20794 raft_consensus.cc:729] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e2f36339d640e1b7b05351ecbd01e3, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.973701 20794 consensus_queue.cc:260] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.973960 20797 raft_consensus.cc:348] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.974108 20797 raft_consensus.cc:374] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:28.974144 20797 raft_consensus.cc:729] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Initialized, Role: FOLLOWER
I20260811 04:48:28.974180 20794 ts_tablet_manager.cc:1428] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:28.974268 20797 consensus_queue.cc:260] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:28.974562 20797 ts_tablet_manager.cc:1428] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 04:48:29.077857 20775 raft_consensus.cc:482] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:29.078008 20775 raft_consensus.cc:504] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:29.078531 20775 leader_election.cc:288] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:29.079303 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc971c823864472fb3244b19267acfb8" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3" is_pre_election: true
I20260811 04:48:29.079473 20296 raft_consensus.cc:2454] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 0.
I20260811 04:48:29.079479 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc971c823864472fb3244b19267acfb8" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4" is_pre_election: true
I20260811 04:48:29.079636 20463 raft_consensus.cc:2454] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 0.
I20260811 04:48:29.079836 20542 leader_election.cc:302] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 64e2f36339d640e1b7b05351ecbd01e3, d1022be82d954d8ba0e3fcfe915d164d; no voters:
I20260811 04:48:29.080021 20775 raft_consensus.cc:2781] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:29.080080 20775 raft_consensus.cc:482] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:29.080137 20775 raft_consensus.cc:3037] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:29.081159 20775 raft_consensus.cc:504] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:29.081524 20775 leader_election.cc:288] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 election: Requested vote from peers 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429), fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019)
I20260811 04:48:29.081859 20296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc971c823864472fb3244b19267acfb8" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64e2f36339d640e1b7b05351ecbd01e3"
I20260811 04:48:29.081919 20463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc971c823864472fb3244b19267acfb8" candidate_uuid: "d1022be82d954d8ba0e3fcfe915d164d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe9e42b144f5486baded5720375b1da4"
I20260811 04:48:29.081984 20296 raft_consensus.cc:3037] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:29.082058 20463 raft_consensus.cc:3037] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:29.082955 20463 raft_consensus.cc:2454] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 1.
I20260811 04:48:29.083263 20541 leader_election.cc:302] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d1022be82d954d8ba0e3fcfe915d164d, fe9e42b144f5486baded5720375b1da4; no voters:
I20260811 04:48:29.083464 20775 raft_consensus.cc:2781] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:29.083587 20775 raft_consensus.cc:686] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 1 LEADER]: Becoming Leader. State: Replica: d1022be82d954d8ba0e3fcfe915d164d, State: Running, Role: LEADER
I20260811 04:48:29.083711 20296 raft_consensus.cc:2454] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1022be82d954d8ba0e3fcfe915d164d in term 1.
I20260811 04:48:29.083730 20775 consensus_queue.cc:237] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } }
I20260811 04:48:29.085557 20122 catalog_manager.cc:5495] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d reported cstate change: term changed from 0 to 1, leader changed from <none> to d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67). New cstate: current_term: 1 leader_uuid: "d1022be82d954d8ba0e3fcfe915d164d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d1022be82d954d8ba0e3fcfe915d164d" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42263 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:29.103917 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:29.100681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49110 (local address 127.17.188.67:42263)
0811 04:48:29.100852 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:29.100856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:29.100872 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:29.100951 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:29.100954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:29.100999 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:29.101078 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:29.101271 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.102023 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.102809 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.103147 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.103261 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:29.103469 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:29.103553 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:29.103634 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:29.103740 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 04:48:29.103786 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 04:48:29.112278 20805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:29.109629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:57275 (local address 127.17.188.67:42263)
0811 04:48:29.109831 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:29.109833 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:29.109840 (+ 7us) server_negotiation.cc:407] Connection header received
0811 04:48:29.109861 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:29.109862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:29.109887 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:29.109954 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:29.110141 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.110574 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.111321 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.111508 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.111604 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:29.111898 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:29.111953 (+ 55us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:29.112025 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:29.112111 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 04:48:29.112149 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":162}
I20260811 04:48:29.112278 20817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:29.109494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42263 (local address 127.17.188.67:57275)
0811 04:48:29.109674 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:29.109691 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:29.109747 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:29.109960 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:29.109962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:29.109968 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:29.110033 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:29.110038 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.110691 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.110694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:29.111218 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:29.111224 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:29.111603 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:29.111618 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:29.111732 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:29.111772 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:29.112027 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:29.112035 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:48:29.112098 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 04:48:29.112178 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":33}
I20260811 04:48:29.126953 20296 raft_consensus.cc:1261] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3 [term 1 FOLLOWER]: Refusing update from remote peer d1022be82d954d8ba0e3fcfe915d164d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:29.127390 20761 consensus_queue.cc:1035] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Connected to new peer: Peer: permanent_uuid: "64e2f36339d640e1b7b05351ecbd01e3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 46429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:29.127779 20463 raft_consensus.cc:1261] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Refusing update from remote peer d1022be82d954d8ba0e3fcfe915d164d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:29.134236 20775 consensus_queue.cc:1035] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe9e42b144f5486baded5720375b1da4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 04:48:29.144721 20757 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 04:48:30.694581 20122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:30.694753 20122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:30.696957 20122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b949ec5056c541bcbf82b9e56a941eb6: Sending DeleteTablet for 3 replicas of tablet fc971c823864472fb3244b19267acfb8
I20260811 04:48:30.697561 20276 tablet_service.cc:1514] Processing DeleteTablet for tablet fc971c823864472fb3244b19267acfb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:30 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58354
I20260811 04:48:30.697613 20597 tablet_service.cc:1514] Processing DeleteTablet for tablet fc971c823864472fb3244b19267acfb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:30 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49094
I20260811 04:48:30.697950 20852 tablet_replica.cc:330] T fc971c823864472fb3244b19267acfb8 P 64e2f36339d640e1b7b05351ecbd01e3: stopping tablet replica
I20260811 04:48:30.697942 20422 tablet_service.cc:1514] Processing DeleteTablet for tablet fc971c823864472fb3244b19267acfb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:30 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:39422
I20260811 04:48:30.698033 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20204
I20260811 04:48:30.698668 20851 tablet_replica.cc:330] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: stopping tablet replica
I20260811 04:48:30.698808 20851 raft_consensus.cc:2229] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:30.699090 20851 raft_consensus.cc:2258] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:30.700526 20853 tablet_replica.cc:330] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: stopping tablet replica
I20260811 04:48:30.700640 20853 raft_consensus.cc:2229] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:30.700708 20853 raft_consensus.cc:2258] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:30.701252 20853 ts_tablet_manager.cc:1905] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:30.702001 20851 ts_tablet_manager.cc:1905] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:30.704120 20853 ts_tablet_manager.cc:1918] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 04:48:30.704236 20853 log.cc:1196] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/fc971c823864472fb3244b19267acfb8
I20260811 04:48:30.704551 20853 ts_tablet_manager.cc:1939] T fc971c823864472fb3244b19267acfb8 P fe9e42b144f5486baded5720375b1da4: Deleting consensus metadata
I20260811 04:48:30.704923 20851 ts_tablet_manager.cc:1918] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 04:48:30.705003 20851 log.cc:1196] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/fc971c823864472fb3244b19267acfb8
I20260811 04:48:30.705271 20103 catalog_manager.cc:4841] TS fe9e42b144f5486baded5720375b1da4 (127.17.188.66:38019): tablet fc971c823864472fb3244b19267acfb8 (table test-table [id=13725dbe1433402dae12a8bb443448d1]) successfully deleted
I20260811 04:48:30.705334 20851 ts_tablet_manager.cc:1939] T fc971c823864472fb3244b19267acfb8 P d1022be82d954d8ba0e3fcfe915d164d: Deleting consensus metadata
I20260811 04:48:30.705973 20103 catalog_manager.cc:4841] TS d1022be82d954d8ba0e3fcfe915d164d (127.17.188.67:42263): tablet fc971c823864472fb3244b19267acfb8 (table test-table [id=13725dbe1433402dae12a8bb443448d1]) successfully deleted
W20260811 04:48:30.708388 20104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:46429 (error 108)
I20260811 04:48:30.708606 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20365
I20260811 04:48:30.710973 20856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:30.710584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:46429 (local address 127.0.0.1:58368)
0811 04:48:30.710816 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:30.710894 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:46429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":87,"threads_started":1}
W20260811 04:48:30.711118 20104 catalog_manager.cc:4584] TS 64e2f36339d640e1b7b05351ecbd01e3 (127.17.188.65:46429): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fc971c823864472fb3244b19267acfb8: Network error: Client connection negotiation failed: client connection to 127.17.188.65:46429: connect: Connection refused (error 111)
I20260811 04:48:30.718119 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20523
I20260811 04:48:30.727411 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20087
2026-08-11T04:48:30Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6259 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:30 dist-test-slave-njxd krb5kdc[20860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:30 dist-test-slave-njxd krb5kdc[20860](info): set up 2 sockets
Aug 11 04:48:30 dist-test-slave-njxd krb5kdc[20860](info): commencing operation
krb5kdc: starting...
W20260811 04:48:31.806250 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:31 dist-test-slave-njxd krb5kdc[20860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:31.924470 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34757
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34757
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:32.034834 20875 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:32.035089 20875 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:32.035130 20875 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:32.038959 20875 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:32.039021 20875 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:32.039039 20875 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:32.039057 20875 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:32.039072 20875 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:32.044086 20875 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34757
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20875
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:32.045069 20875 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:32.046114 20875 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:32.054272 20881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.054272 20884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.054502 20875 server_base.cc:1034] running on GCE node
W20260811 04:48:32.054507 20882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.055199 20875 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:32.056249 20875 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:32.057432 20875 hybrid_clock.cc:648] HybridClock initialized: now 1786423712057408 us; error 38 us; skew 500 ppm
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:32.060210 20875 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:32.061060 20875 webserver.cc:460] Webserver started at http://127.17.188.126:42587/ using document root <none> and password file <none>
I20260811 04:48:32.061689 20875 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:32.061781 20875 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:32.062019 20875 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:32.064049 20875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "f0cbfa61a636452586919c55d372b6e7"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "7e87b74b95589e64420b4c34cb0aaf41"
server_key_iv: "525e261814eefa1765babb5e63b842ce"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.064611 20875 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "f0cbfa61a636452586919c55d372b6e7"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "7e87b74b95589e64420b4c34cb0aaf41"
server_key_iv: "525e261814eefa1765babb5e63b842ce"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.068331 20875 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260811 04:48:32.070863 20894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.072070 20875 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:32.072234 20875 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "f0cbfa61a636452586919c55d372b6e7"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "7e87b74b95589e64420b4c34cb0aaf41"
server_key_iv: "525e261814eefa1765babb5e63b842ce"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.072342 20875 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:32.084285 20875 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:32.087060 20875 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:32.087249 20875 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:32.093981 20875 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34757
I20260811 04:48:32.094034 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34757 every 8 connection(s)
I20260811 04:48:32.094947 20875 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:32.097568 20953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:32.100498 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20875
I20260811 04:48:32.100651 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:32.100893 18161 external_mini_cluster.cc:1428] Setting key 54ad9d61bf72b44e6821661ee120856b
I20260811 04:48:32.103176 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: Bootstrap starting.
I20260811 04:48:32.105687 20953 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:32.106576 20953 log.cc:824] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:32.108796 20953 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: No bootstrap required, opened a new log
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:32.112825 20953 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } }
I20260811 04:48:32.113124 20953 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:32.113198 20953 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0cbfa61a636452586919c55d372b6e7, State: Initialized, Role: FOLLOWER
I20260811 04:48:32.113736 20953 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } }
I20260811 04:48:32.113904 20953 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:32.113986 20953 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:32.114094 20953 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:32.115103 20953 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } }
I20260811 04:48:32.115485 20953 leader_election.cc:302] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0cbfa61a636452586919c55d372b6e7; no voters:
I20260811 04:48:32.115859 20953 leader_election.cc:288] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:32.115921 20958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:32.116122 20958 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [term 1 LEADER]: Becoming Leader. State: Replica: f0cbfa61a636452586919c55d372b6e7, State: Running, Role: LEADER
I20260811 04:48:32.116441 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.102249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47416 (local address 127.17.188.126:34757)
0811 04:48:32.102631 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:32.102646 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:32.102680 (+ 34us) server_negotiation.cc:407] Connection header received
0811 04:48:32.103267 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:32.103304 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:32.103630 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:32.103900 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:32.104845 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.105951 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.107124 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.107714 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.107840 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.110630 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:32.110637 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:32.110654 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:32.110688 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:32.113236 (+ 2548us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.113705 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.113711 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.113716 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.113890 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.114259 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.114262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.114264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.114704 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:32.114865 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:32.115225 (+ 360us) server_negotiation.cc:299] Negotiation successful
0811 04:48:32.115507 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":121,"threads_started":1}
I20260811 04:48:32.116468 20958 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } }
I20260811 04:48:32.117125 20953 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:32.119491 20959 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0cbfa61a636452586919c55d372b6e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } } }
I20260811 04:48:32.119585 20960 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0cbfa61a636452586919c55d372b6e7. Latest consensus state: current_term: 1 leader_uuid: "f0cbfa61a636452586919c55d372b6e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0cbfa61a636452586919c55d372b6e7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34757 } } }
I20260811 04:48:32.119819 20960 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:32.119819 20959 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7 [sys.catalog]: This master's current role is: LEADER
W20260811 04:48:32.122262 20976 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:48:32.122339 20976 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:48:32.122433 20978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:32.123307 20978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:32.130834 20978 catalog_manager.cc:1347] Generated new cluster ID: e805c949568a45d2bb9fed48e7a07538
I20260811 04:48:32.130905 20978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:32.164233 20978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:32.165203 20978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:32.175423 20978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0cbfa61a636452586919c55d372b6e7: Generated new TSK 0
I20260811 04:48:32.176227 20978 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:32.213397 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:32.327948 20984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:32.328208 20984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:32.328251 20984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:32.332366 20984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:32.332428 20984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:32.332515 20984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:32.337795 20984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:32.338990 20984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:32.340273 20984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:32.349893 20989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.349997 20990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.349893 20992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.350262 20984 server_base.cc:1034] running on GCE node
I20260811 04:48:32.350680 20984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:32.351312 20984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:32.352470 20984 hybrid_clock.cc:648] HybridClock initialized: now 1786423712352450 us; error 32 us; skew 500 ppm
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:32.355274 20984 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:32.356120 20984 webserver.cc:460] Webserver started at http://127.17.188.65:42039/ using document root <none> and password file <none>
I20260811 04:48:32.356663 20984 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:32.356720 20984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:32.356890 20984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:32.359166 20984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "5d10bec57ef244dab341448aeed4b6a5"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "6a4c2f9ae6bfda37be66e559a2dd736d"
server_key_iv: "a2ba58a75283f4341fedddbaa40cae90"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.359752 20984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "5d10bec57ef244dab341448aeed4b6a5"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "6a4c2f9ae6bfda37be66e559a2dd736d"
server_key_iv: "a2ba58a75283f4341fedddbaa40cae90"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.363842 20984 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 04:48:32.366850 21001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.368240 20984 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:32.368366 20984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "5d10bec57ef244dab341448aeed4b6a5"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "6a4c2f9ae6bfda37be66e559a2dd736d"
server_key_iv: "a2ba58a75283f4341fedddbaa40cae90"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.368476 20984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:32.382512 20984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:32.385535 20984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:32.385824 20984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:32.386448 20984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:32.387311 20984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:32.387358 20984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.387437 20984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:32.387468 20984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.396091 20984 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:34625
I20260811 04:48:32.396147 21128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:34625 every 8 connection(s)
I20260811 04:48:32.397043 20984 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:32.401180 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 20984
I20260811 04:48:32.401302 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:32.401620 18161 external_mini_cluster.cc:1428] Setting key 406605b0cc95f01d944ccf7388f75947
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:32.410629 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.398909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:37961 (local address 127.17.188.126:34757)
0811 04:48:32.399049 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:32.399053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:32.399856 (+ 803us) server_negotiation.cc:407] Connection header received
0811 04:48:32.401133 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:32.401136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:32.401194 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:32.401294 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:32.402654 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.403168 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.404274 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.404498 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.404625 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.407137 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:32.407141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:32.407143 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:32.407168 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:32.408608 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.409107 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.409112 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.409113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.409191 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.409514 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.409518 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.409520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.409758 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:32.409861 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:32.410341 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 04:48:32.410460 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:32.411458 21131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.399278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34757 (local address 127.17.188.65:37961)
0811 04:48:32.399716 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:32.399760 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:32.400905 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:32.401463 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:32.401470 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:32.401942 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:32.402507 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.402523 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.403293 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.403296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.404140 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.404149 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.404666 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.404670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.404844 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.405446 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:32.405463 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:32.406968 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:32.408733 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.408739 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.408753 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.409005 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.409278 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.409282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.409284 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.409422 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.409862 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:32.409869 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:32.410107 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 04:48:32.410298 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 04:48:32.410605 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":114,"threads_started":1}
I20260811 04:48:32.412640 21129 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34757
I20260811 04:48:32.412884 21129 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:32.413434 21129 heartbeater.cc:511] Master 127.17.188.126:34757 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:32.415192 20913 ts_manager.cc:194] Registered new tserver with Master: 5d10bec57ef244dab341448aeed4b6a5 (127.17.188.65:34625)
I20260811 04:48:32.416391 20913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:37961
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:32.428889 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:32.540062 21134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:32.540351 21134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:32.540427 21134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:32.544505 21134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:32.544592 21134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:32.544692 21134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:32.549768 21134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:32.550765 21134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:32.551784 21134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:32.561038 21144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.561019 21140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.561110 21134 server_base.cc:1034] running on GCE node
W20260811 04:48:32.561019 21141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.561780 21134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:32.562407 21134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:32.563557 21134 hybrid_clock.cc:648] HybridClock initialized: now 1786423712563526 us; error 45 us; skew 500 ppm
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:32.566352 21134 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:32.567237 21134 webserver.cc:460] Webserver started at http://127.17.188.66:36559/ using document root <none> and password file <none>
I20260811 04:48:32.567778 21134 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:32.567836 21134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:32.568158 21134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:32.570235 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "e42e7ee10cf5481287b654022135e2dd"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "2d2d84285aee4f21fd5154f85765b3f0"
server_key_iv: "e285752cf6414d8f10f683a4fd44782d"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.570801 21134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "e42e7ee10cf5481287b654022135e2dd"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "2d2d84285aee4f21fd5154f85765b3f0"
server_key_iv: "e285752cf6414d8f10f683a4fd44782d"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.574611 21134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:32.577062 21151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.578262 21134 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:32.578384 21134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "e42e7ee10cf5481287b654022135e2dd"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "2d2d84285aee4f21fd5154f85765b3f0"
server_key_iv: "e285752cf6414d8f10f683a4fd44782d"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.578486 21134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:32.593063 21134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:32.596094 21134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:32.596282 21134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:32.596830 21134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:32.597667 21134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:32.597728 21134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.597795 21134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:32.597839 21134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.606501 21134 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:44409
I20260811 04:48:32.606527 21283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:44409 every 8 connection(s)
I20260811 04:48:32.607322 21134 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:32.615646 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21134
I20260811 04:48:32.615777 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:32.616058 18161 external_mini_cluster.cc:1428] Setting key 0707ae0270c4650bd77b7ed27d4f99da
I20260811 04:48:32.620610 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.609065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44893 (local address 127.17.188.126:34757)
0811 04:48:32.609218 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:32.609222 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:32.610096 (+ 874us) server_negotiation.cc:407] Connection header received
0811 04:48:32.611251 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:32.611254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:32.611299 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:32.611370 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:32.612409 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.612904 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.613982 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.614197 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.614271 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.616757 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:32.616761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:32.616763 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:32.616786 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:32.618414 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.618935 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.618940 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.618941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.619026 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.619391 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.619395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.619396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.619614 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:32.619724 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:32.620220 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 04:48:32.620352 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:48:32.621150 21286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.609483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34757 (local address 127.17.188.66:44893)
0811 04:48:32.609943 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:32.609984 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:32.611064 (+ 1080us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:32.611518 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:32.611524 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:32.611844 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:32.612278 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.612290 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.612998 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.613001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.613875 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.613884 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.614310 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.614313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.614437 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.614971 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:32.614987 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:32.616447 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:32.618532 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.618538 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.618561 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.618848 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.619137 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.619139 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.619141 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.619276 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.619720 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:32.619725 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:32.619918 (+ 193us) client_negotiation.cc:769] Sending connection context
0811 04:48:32.620138 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 04:48:32.620393 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":113,"threads_started":1}
I20260811 04:48:32.622216 21284 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34757
I20260811 04:48:32.622437 21284 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:32.623005 21284 heartbeater.cc:511] Master 127.17.188.126:34757 requested a full tablet report, sending...
I20260811 04:48:32.624090 20913 ts_manager.cc:194] Registered new tserver with Master: e42e7ee10cf5481287b654022135e2dd (127.17.188.66:44409)
I20260811 04:48:32.624622 20913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:44893
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:32.645115 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:45049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:32.757233 21289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:32.757491 21289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:32.757563 21289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:32.761366 21289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:32.761445 21289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:32.761533 21289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:32.766525 21289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:45049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:32.767534 21289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:32.768617 21289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:32.777946 21301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.777953 21298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:32.777988 21296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:32.778345 21289 server_base.cc:1034] running on GCE node
I20260811 04:48:32.778712 21289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:32.779263 21289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:32.780472 21289 hybrid_clock.cc:648] HybridClock initialized: now 1786423712780445 us; error 36 us; skew 500 ppm
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:32.783213 21289 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:32.784015 21289 webserver.cc:460] Webserver started at http://127.17.188.67:40321/ using document root <none> and password file <none>
I20260811 04:48:32.784556 21289 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:32.784641 21289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:32.784893 21289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:32.786921 21289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "5d8690e042804682951f33a937cfb27d"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "4c0251305d5e40ce9176209e846d3b3a"
server_key_iv: "8c9b8d7a1e927cb005c2d5dc744da727"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.787482 21289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "5d8690e042804682951f33a937cfb27d"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "4c0251305d5e40ce9176209e846d3b3a"
server_key_iv: "8c9b8d7a1e927cb005c2d5dc744da727"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.791111 21289 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 04:48:32.793555 21308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.794816 21289 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:32.794950 21289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "5d8690e042804682951f33a937cfb27d"
format_stamp: "Formatted at 2026-08-11 04:48:32 on dist-test-slave-njxd"
server_key: "4c0251305d5e40ce9176209e846d3b3a"
server_key_iv: "8c9b8d7a1e927cb005c2d5dc744da727"
server_key_version: "encryptionkey@0"
I20260811 04:48:32.795053 21289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:32.808504 21289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:32.811106 21289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:32.811290 21289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:32.811841 21289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:32.812588 21289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:32.812654 21289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.812722 21289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:32.812768 21289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:32.821609 21289 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43211
I20260811 04:48:32.821672 21430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43211 every 8 connection(s)
I20260811 04:48:32.822467 21289 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[20860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423712, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:32.831470 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21289
I20260811 04:48:32.831605 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:32.831964 18161 external_mini_cluster.cc:1428] Setting key 66287b1a77746ae4bb5c0ab4ae471110
I20260811 04:48:32.835319 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.824169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56237 (local address 127.17.188.126:34757)
0811 04:48:32.824313 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:32.824316 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:32.825089 (+ 773us) server_negotiation.cc:407] Connection header received
0811 04:48:32.826302 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:32.826304 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:32.826350 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:32.826420 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:32.827491 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.827992 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.829048 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.829260 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.829337 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.831736 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:32.831740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:32.831742 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:32.831769 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:32.833448 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.834003 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.834009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.834010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.834096 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:32.834418 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:32.834420 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:32.834421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:32.834624 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:32.834696 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:32.835120 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 04:48:32.835208 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:32.836046 21433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:32.824519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34757 (local address 127.17.188.67:56237)
0811 04:48:32.824944 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:32.824985 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:32.826118 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:32.826569 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:32.826576 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:32.826903 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:32.827375 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.827387 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.828112 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.828114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.828948 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:32.828956 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:32.829395 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:32.829398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:32.829531 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:32.830135 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:32.830151 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:32.831521 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:32.833543 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.833549 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.833561 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.833914 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.834179 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:32.834182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:32.834183 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:32.834327 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:32.834720 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:32.834725 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:32.834922 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 04:48:32.835061 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 04:48:32.835287 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":124,"threads_started":1}
I20260811 04:48:32.837049 21431 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34757
I20260811 04:48:32.837265 21431 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:32.837754 21431 heartbeater.cc:511] Master 127.17.188.126:34757 requested a full tablet report, sending...
I20260811 04:48:32.838629 20913 ts_manager.cc:194] Registered new tserver with Master: 5d8690e042804682951f33a937cfb27d (127.17.188.67:43211)
I20260811 04:48:32.839113 20913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:56237
I20260811 04:48:32.845521 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 04:48:32.858737 20956 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:32.857505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47430 (local address 127.17.188.126:34757)
0811 04:48:32.857672 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:32.857676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:32.857776 (+ 100us) server_negotiation.cc:407] Connection header received
0811 04:48:32.857876 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:32.857878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:32.857912 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:32.857979 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:32.858647 (+ 668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47430: BlockingRecv error: recv got EOF from 127.0.0.1:47430 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 04:48:32.859772 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20984
I20260811 04:48:32.868700 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21134
I20260811 04:48:32.874856 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21289
I20260811 04:48:32.884900 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 20875
2026-08-11T04:48:32Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2155 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[21443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[21443](info): set up 2 sockets
Aug 11 04:48:32 dist-test-slave-njxd krb5kdc[21443](info): commencing operation
krb5kdc: starting...
W20260811 04:48:33.965983 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:34.096726 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35145
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:35145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:34.206260 21457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:34.206502 21457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:34.206599 21457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:34.210531 21457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:34.210582 21457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:34.210601 21457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:34.210618 21457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:34.210632 21457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:34.215700 21457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:35145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:34.216658 21457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:34.217635 21457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:34.225956 21463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:34.225986 21462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:34.225988 21465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:34.226164 21457 server_base.cc:1034] running on GCE node
I20260811 04:48:34.226814 21457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:34.227883 21457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:34.229061 21457 hybrid_clock.cc:648] HybridClock initialized: now 1786423714229033 us; error 40 us; skew 500 ppm
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423714, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:34.236454 21457 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:34.237339 21457 webserver.cc:460] Webserver started at http://127.17.188.126:34247/ using document root <none> and password file <none>
I20260811 04:48:34.237957 21457 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:34.238044 21457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:34.238266 21457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:34.240267 21457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "b6015c99c09c48e9bcef8840fb5b8705"
format_stamp: "Formatted at 2026-08-11 04:48:34 on dist-test-slave-njxd"
server_key: "16c823d36bdeee599066d6a472d3cd72"
server_key_iv: "37d725399effbecc82673fd22a5e327e"
server_key_version: "encryptionkey@0"
I20260811 04:48:34.240826 21457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "b6015c99c09c48e9bcef8840fb5b8705"
format_stamp: "Formatted at 2026-08-11 04:48:34 on dist-test-slave-njxd"
server_key: "16c823d36bdeee599066d6a472d3cd72"
server_key_iv: "37d725399effbecc82673fd22a5e327e"
server_key_version: "encryptionkey@0"
I20260811 04:48:34.244441 21457 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:48:34.246814 21474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:34.248039 21457 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:34.248199 21457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "b6015c99c09c48e9bcef8840fb5b8705"
format_stamp: "Formatted at 2026-08-11 04:48:34 on dist-test-slave-njxd"
server_key: "16c823d36bdeee599066d6a472d3cd72"
server_key_iv: "37d725399effbecc82673fd22a5e327e"
server_key_version: "encryptionkey@0"
I20260811 04:48:34.248310 21457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:34.263087 21457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:34.266912 21457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:34.267119 21457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:34.275125 21457 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:35145
I20260811 04:48:34.275378 21530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:35145 every 8 connection(s)
I20260811 04:48:34.276162 21457 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:34.279028 21532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:34.282671 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21457
I20260811 04:48:34.282800 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:34.283082 18161 external_mini_cluster.cc:1428] Setting key 3ce209f941f4c473ba4cfc8e58f9e758
I20260811 04:48:34.285177 21532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705: Bootstrap starting.
I20260811 04:48:34.287461 21532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:34.288213 21532 log.cc:824] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:34.290146 21532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705: No bootstrap required, opened a new log
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423714, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:34.294041 21532 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } }
I20260811 04:48:34.294253 21532 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:34.294334 21532 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6015c99c09c48e9bcef8840fb5b8705, State: Initialized, Role: FOLLOWER
I20260811 04:48:34.294759 21532 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } }
I20260811 04:48:34.294875 21532 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:34.294958 21532 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:34.295053 21532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:34.296219 21532 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } }
I20260811 04:48:34.296557 21532 leader_election.cc:302] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6015c99c09c48e9bcef8840fb5b8705; no voters:
I20260811 04:48:34.296881 21532 leader_election.cc:288] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:34.296955 21537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:34.297153 21537 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [term 1 LEADER]: Becoming Leader. State: Replica: b6015c99c09c48e9bcef8840fb5b8705, State: Running, Role: LEADER
I20260811 04:48:34.297446 21537 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } }
I20260811 04:48:34.298223 21532 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:34.298647 21537 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6015c99c09c48e9bcef8840fb5b8705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } } }
I20260811 04:48:34.298761 21537 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:34.298763 21535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:34.284457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56304 (local address 127.17.188.126:35145)
0811 04:48:34.285046 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:34.285069 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:34.285121 (+ 52us) server_negotiation.cc:407] Connection header received
0811 04:48:34.285899 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:34.285920 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:34.286296 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:34.286660 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:34.287554 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:34.288639 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:34.289516 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:34.290050 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:34.290217 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:34.293044 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:34.293050 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:34.293064 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:34.293090 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:34.295211 (+ 2121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:34.295690 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:34.295695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:34.295699 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:34.295812 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:34.296144 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:34.296146 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:34.296147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:34.296620 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:34.296820 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:34.297498 (+ 678us) server_negotiation.cc:299] Negotiation successful
0811 04:48:34.297825 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":135,"threads_started":1}
I20260811 04:48:34.299432 21538 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6015c99c09c48e9bcef8840fb5b8705. Latest consensus state: current_term: 1 leader_uuid: "b6015c99c09c48e9bcef8840fb5b8705" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6015c99c09c48e9bcef8840fb5b8705" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35145 } } }
I20260811 04:48:34.299546 21538 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:34.299813 21541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:34.301826 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:48:34.302690 21541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:34.307899 21541 catalog_manager.cc:1347] Generated new cluster ID: 83d7ba767660480294a068a4246cc028
I20260811 04:48:34.307962 21541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:34.318168 21541 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:34.319383 21541 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:34.324671 21541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6015c99c09c48e9bcef8840fb5b8705: Generated new TSK 0
I20260811 04:48:34.325498 21541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:48:34.325794 21535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:34.320574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56320 (local address 127.17.188.126:35145)
0811 04:48:34.320712 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:34.320716 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:34.321010 (+ 294us) server_negotiation.cc:407] Connection header received
0811 04:48:34.321198 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:34.321200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:34.321244 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:34.321324 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:34.321914 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:34.322460 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:34.323364 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:34.323735 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:34.323854 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:34.324790 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:34.324795 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:34.324798 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:34.325286 (+ 488us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:34.325315 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:34.325332 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:34.325432 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:34.325544 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 04:48:34.325655 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:34.330569 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21457
2026-08-11T04:48:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1446 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21566](info): set up 2 sockets
Aug 11 04:48:34 dist-test-slave-njxd krb5kdc[21566](info): commencing operation
krb5kdc: starting...
W20260811 04:48:35.418177 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:35 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:35.542963 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37133
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:37133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:35.656752 21580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:35.657012 21580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:35.657050 21580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:35.661188 21580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:35.661248 21580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:35.661268 21580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:35.661284 21580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:35.661299 21580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:35.666561 21580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:37133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:35.667541 21580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:35.668555 21580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:35.676873 21580 server_base.cc:1034] running on GCE node
W20260811 04:48:35.676939 21589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:35.676997 21587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:35.676918 21586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:35.677765 21580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:35.678783 21580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:35.679975 21580 hybrid_clock.cc:648] HybridClock initialized: now 1786423715679955 us; error 35 us; skew 500 ppm
Aug 11 04:48:35 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:35.682753 21580 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:35.683609 21580 webserver.cc:460] Webserver started at http://127.17.188.126:45445/ using document root <none> and password file <none>
I20260811 04:48:35.684130 21580 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:35.684190 21580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:35.684417 21580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:35.686476 21580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "c66de48a688c4da08d19732ca6174c64"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "2bd337db99924dd4fab2fc700f36f3d4"
server_key_iv: "19e827d3070a43d1b7a606780481ae13"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.687038 21580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "c66de48a688c4da08d19732ca6174c64"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "2bd337db99924dd4fab2fc700f36f3d4"
server_key_iv: "19e827d3070a43d1b7a606780481ae13"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.690811 21580 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:35.693082 21597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:35.694295 21580 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:35.694420 21580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "c66de48a688c4da08d19732ca6174c64"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "2bd337db99924dd4fab2fc700f36f3d4"
server_key_iv: "19e827d3070a43d1b7a606780481ae13"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.694520 21580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:35.712379 21580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:35.715221 21580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:35.715421 21580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:35.722172 21580 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:37133
I20260811 04:48:35.722478 21654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:37133 every 8 connection(s)
I20260811 04:48:35.723206 21580 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:35.726011 21655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:35.729784 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21580
I20260811 04:48:35.729914 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:35.730180 18161 external_mini_cluster.cc:1428] Setting key 01f91df1b3b867fed098d65a251cd9fe
I20260811 04:48:35.731791 21655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64: Bootstrap starting.
I20260811 04:48:35.734283 21655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:35.735086 21655 log.cc:824] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:35.737321 21655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64: No bootstrap required, opened a new log
Aug 11 04:48:35 dist-test-slave-njxd krb5kdc[21566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423715, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:35.741669 21655 raft_consensus.cc:348] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } }
I20260811 04:48:35.741967 21655 raft_consensus.cc:374] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:35.742033 21655 raft_consensus.cc:729] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c66de48a688c4da08d19732ca6174c64, State: Initialized, Role: FOLLOWER
I20260811 04:48:35.742497 21655 consensus_queue.cc:260] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } }
I20260811 04:48:35.742689 21655 raft_consensus.cc:388] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:35.742772 21655 raft_consensus.cc:482] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:35.742872 21655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:35.744065 21655 raft_consensus.cc:504] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } }
I20260811 04:48:35.744417 21655 leader_election.cc:302] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c66de48a688c4da08d19732ca6174c64; no voters:
I20260811 04:48:35.744752 21655 leader_election.cc:288] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:35.744870 21661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:35.745136 21661 raft_consensus.cc:686] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [term 1 LEADER]: Becoming Leader. State: Replica: c66de48a688c4da08d19732ca6174c64, State: Running, Role: LEADER
I20260811 04:48:35.745360 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:35.731656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59966 (local address 127.17.188.126:37133)
0811 04:48:35.732057 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:35.732073 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:35.732109 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:48:35.732754 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:35.732771 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:35.733105 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:35.733384 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:35.734435 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:35.735533 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:35.736494 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:35.737194 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:35.737377 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:35.739991 (+ 2614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:35.739998 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:35.740020 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:35.740064 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:35.742128 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:35.742602 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:35.742608 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:35.742615 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:35.742778 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:35.743081 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:35.743087 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:35.743091 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:35.743586 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:35.743788 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:35.744003 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 04:48:35.744321 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":127,"threads_started":1}
I20260811 04:48:35.745513 21661 consensus_queue.cc:237] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } }
I20260811 04:48:35.746850 21655 sys_catalog.cc:564] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:35.747929 21662 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c66de48a688c4da08d19732ca6174c64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } } }
I20260811 04:48:35.748054 21662 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:35.748433 21663 sys_catalog.cc:455] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c66de48a688c4da08d19732ca6174c64. Latest consensus state: current_term: 1 leader_uuid: "c66de48a688c4da08d19732ca6174c64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c66de48a688c4da08d19732ca6174c64" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37133 } } }
I20260811 04:48:35.748571 21670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:35.748600 21663 sys_catalog.cc:458] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:35.751597 21670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:35.756933 21670 catalog_manager.cc:1347] Generated new cluster ID: f045f8ebad104e5fae1aee0e4b7e752e
I20260811 04:48:35.757014 21670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:35.773965 21670 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:35.775005 21670 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:35.785017 21670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c66de48a688c4da08d19732ca6174c64: Generated new TSK 0
I20260811 04:48:35.785771 21670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:35.815918 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:35.929131 21686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:35.929388 21686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:35.929432 21686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:35.933312 21686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:35.933377 21686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:35.933482 21686 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:35.938887 21686 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:35.939922 21686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:35.940922 21686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:35.950686 21692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:35.950685 21691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:35.950920 21686 server_base.cc:1034] running on GCE node
W20260811 04:48:35.950680 21694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:35.951429 21686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:35.952031 21686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:35.953187 21686 hybrid_clock.cc:648] HybridClock initialized: now 1786423715953171 us; error 27 us; skew 500 ppm
Aug 11 04:48:35 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:35.960300 21686 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:35.961138 21686 webserver.cc:460] Webserver started at http://127.17.188.65:38249/ using document root <none> and password file <none>
I20260811 04:48:35.961743 21686 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:35.961831 21686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:35.962056 21686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:35.964003 21686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "4b122f8ef28d437098b9bfd4b4da3717"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "ee2dd64e752a989ab6e85f0be85ff725"
server_key_iv: "dce197c915f4923e47685ca40f3f704c"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.964556 21686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "4b122f8ef28d437098b9bfd4b4da3717"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "ee2dd64e752a989ab6e85f0be85ff725"
server_key_iv: "dce197c915f4923e47685ca40f3f704c"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.968434 21686 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 04:48:35.970830 21703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:35.971984 21686 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:35.972124 21686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "4b122f8ef28d437098b9bfd4b4da3717"
format_stamp: "Formatted at 2026-08-11 04:48:35 on dist-test-slave-njxd"
server_key: "ee2dd64e752a989ab6e85f0be85ff725"
server_key_iv: "dce197c915f4923e47685ca40f3f704c"
server_key_version: "encryptionkey@0"
I20260811 04:48:35.972227 21686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:35.999357 21686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:36.002209 21686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:36.002403 21686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:36.002988 21686 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:36.003793 21686 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:36.003859 21686 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.003942 21686 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:36.003986 21686 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.013165 21686 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:32945
I20260811 04:48:36.013185 21823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:32945 every 8 connection(s)
I20260811 04:48:36.014076 21686 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:36.022912 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21686
I20260811 04:48:36.023064 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:36.023363 18161 external_mini_cluster.cc:1428] Setting key c407fc645f00b2b09cc27521c275dd0f
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423715, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:36.027541 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.015922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:33923 (local address 127.17.188.126:37133)
0811 04:48:36.016055 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:36.016058 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:36.016926 (+ 868us) server_negotiation.cc:407] Connection header received
0811 04:48:36.018327 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:36.018330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:36.018385 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:36.018465 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:36.019570 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.020097 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.021213 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.021448 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.021558 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.023967 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:36.023971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:36.023973 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:36.023999 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:36.025473 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.026012 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.026015 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.026017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.026103 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.026465 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.026468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.026469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.026639 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:36.026736 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:36.027224 (+ 488us) server_negotiation.cc:299] Negotiation successful
0811 04:48:36.027372 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:36.028443 21826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.016290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:37133 (local address 127.17.188.65:33923)
0811 04:48:36.016772 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:36.016814 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:36.018121 (+ 1307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:36.018625 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:36.018631 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:36.018976 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:36.019422 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.019434 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.020232 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.020235 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.021081 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.021089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.021623 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.021628 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.021797 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.022312 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:36.022328 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:36.023811 (+ 1483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:36.025625 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.025632 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.025648 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.025908 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.026224 (+ 316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.026227 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.026230 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.026370 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.026738 (+ 368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:36.026744 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:36.026981 (+ 237us) client_negotiation.cc:769] Sending connection context
0811 04:48:36.027159 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 04:48:36.027491 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":127,"threads_started":1}
I20260811 04:48:36.029747 21824 heartbeater.cc:347] Connected to a master server at 127.17.188.126:37133
I20260811 04:48:36.030017 21824 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:36.030642 21824 heartbeater.cc:511] Master 127.17.188.126:37133 requested a full tablet report, sending...
I20260811 04:48:36.032186 21617 ts_manager.cc:194] Registered new tserver with Master: 4b122f8ef28d437098b9bfd4b4da3717 (127.17.188.65:32945)
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:36.033309 21617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:33923
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:36.050592 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:36.160013 21829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:36.160250 21829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:36.160290 21829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:36.164143 21829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:36.164194 21829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:36.164247 21829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:36.169378 21829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:36.170379 21829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:36.171319 21829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:36.180651 21837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:36.180701 21834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:36.180806 21835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:36.180823 21829 server_base.cc:1034] running on GCE node
I20260811 04:48:36.181222 21829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:36.181872 21829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:36.183048 21829 hybrid_clock.cc:648] HybridClock initialized: now 1786423716183035 us; error 26 us; skew 500 ppm
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:36.185806 21829 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:36.186695 21829 webserver.cc:460] Webserver started at http://127.17.188.66:37875/ using document root <none> and password file <none>
I20260811 04:48:36.187244 21829 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:36.187333 21829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:36.187585 21829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:36.189697 21829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "71d328a8e3aa42559b7b96e13e2337d3"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "cb00fc2c5f0757cf36eafc02ae042d38"
server_key_iv: "4c0c4f53c0f7a68ab748ef2441b25091"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.190265 21829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "71d328a8e3aa42559b7b96e13e2337d3"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "cb00fc2c5f0757cf36eafc02ae042d38"
server_key_iv: "4c0c4f53c0f7a68ab748ef2441b25091"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.193950 21829 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 04:48:36.196291 21846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.197503 21829 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:36.197680 21829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "71d328a8e3aa42559b7b96e13e2337d3"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "cb00fc2c5f0757cf36eafc02ae042d38"
server_key_iv: "4c0c4f53c0f7a68ab748ef2441b25091"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.197793 21829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:36.214267 21829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:36.217489 21829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:36.217715 21829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:36.218287 21829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:36.219084 21829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:36.219152 21829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.219214 21829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:36.219254 21829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.228019 21829 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38903
I20260811 04:48:36.228050 21976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38903 every 8 connection(s)
I20260811 04:48:36.228863 21829 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:36.237130 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21829
I20260811 04:48:36.237289 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:36.237564 18161 external_mini_cluster.cc:1428] Setting key e12ad606752d7de51cc0d628842e0712
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:36.242283 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.230524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:41249 (local address 127.17.188.126:37133)
0811 04:48:36.230650 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:36.230654 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:36.231413 (+ 759us) server_negotiation.cc:407] Connection header received
0811 04:48:36.232655 (+ 1242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:36.232658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:36.232706 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:36.232778 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:36.233918 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.234450 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.235548 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.235768 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.235844 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.238440 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:36.238443 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:36.238446 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:36.238474 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:36.240169 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.240662 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.240668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.240672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.240774 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.241102 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.241107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.241111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.241353 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:36.241432 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:36.242051 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 04:48:36.242157 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:36.243491 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.230823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:37133 (local address 127.17.188.66:41249)
0811 04:48:36.231256 (+ 433us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:36.231296 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:36.232461 (+ 1165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:36.232901 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:36.232907 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:36.233248 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:36.233787 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.233801 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.234567 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.234569 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.235446 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.235455 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.235891 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.235893 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.236117 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.236615 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:36.236631 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:36.238282 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:36.240310 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.240315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.240327 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.240567 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.240868 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.240870 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.240872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.241004 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.241457 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:36.241465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:36.241798 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 04:48:36.242019 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 04:48:36.242400 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":112,"threads_started":1}
I20260811 04:48:36.244659 21977 heartbeater.cc:347] Connected to a master server at 127.17.188.126:37133
I20260811 04:48:36.244894 21977 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:36.245523 21977 heartbeater.cc:511] Master 127.17.188.126:37133 requested a full tablet report, sending...
I20260811 04:48:36.246726 21617 ts_manager.cc:194] Registered new tserver with Master: 71d328a8e3aa42559b7b96e13e2337d3 (127.17.188.66:38903)
I20260811 04:48:36.247395 21617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:41249
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:36.268101 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:36.381431 21982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:36.381752 21982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:36.381798 21982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:36.385831 21982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:36.385883 21982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:36.385941 21982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:36.391091 21982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:37133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:36.392096 21982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:36.393105 21982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:36.402973 21988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:36.403028 21982 server_base.cc:1034] running on GCE node
W20260811 04:48:36.402976 21990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:36.402938 21987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:36.403549 21982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:36.404171 21982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:36.405355 21982 hybrid_clock.cc:648] HybridClock initialized: now 1786423716405334 us; error 32 us; skew 500 ppm
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:36.408166 21982 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:36.409029 21982 webserver.cc:460] Webserver started at http://127.17.188.67:43055/ using document root <none> and password file <none>
I20260811 04:48:36.409612 21982 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:36.409719 21982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:36.409929 21982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:36.411945 21982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "8443a359154241068019d92e1960ecf4"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "653f268eac1dd5aac0958a965a05a025"
server_key_iv: "b84fe5effa79781f146e58b059ad08cd"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.412492 21982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "8443a359154241068019d92e1960ecf4"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "653f268eac1dd5aac0958a965a05a025"
server_key_iv: "b84fe5effa79781f146e58b059ad08cd"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.416275 21982 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 04:48:36.418689 21998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.419857 21982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:36.419983 21982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "8443a359154241068019d92e1960ecf4"
format_stamp: "Formatted at 2026-08-11 04:48:36 on dist-test-slave-njxd"
server_key: "653f268eac1dd5aac0958a965a05a025"
server_key_iv: "b84fe5effa79781f146e58b059ad08cd"
server_key_version: "encryptionkey@0"
I20260811 04:48:36.420087 21982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:36.430979 21982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:36.433965 21982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:36.434165 21982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:36.434804 21982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:36.435652 21982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:36.435720 21982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.435789 21982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:36.435828 21982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:36.444792 21982 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:36549
I20260811 04:48:36.444814 22121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:36549 every 8 connection(s)
I20260811 04:48:36.445776 21982 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:36.455291 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 21982
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:36.455442 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:36.455793 18161 external_mini_cluster.cc:1428] Setting key 4f150ca48637ff80eabfa0bc702f8a0f
I20260811 04:48:36.460019 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.447658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:58777 (local address 127.17.188.126:37133)
0811 04:48:36.447826 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:36.447831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:36.448736 (+ 905us) server_negotiation.cc:407] Connection header received
0811 04:48:36.450243 (+ 1507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:36.450246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:36.450293 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:36.450358 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:36.451475 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.452004 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.453200 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.453416 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.453510 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.456208 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:36.456213 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:36.456215 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:36.456245 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:36.457968 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.458533 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.458538 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.458540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.458631 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.458967 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.458972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.458974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.459163 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:36.459265 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:36.459741 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 04:48:36.459863 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 04:48:36.460839 22125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.448095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:37133 (local address 127.17.188.67:58777)
0811 04:48:36.448588 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:36.448632 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:36.450025 (+ 1393us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:36.450519 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:36.450525 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:36.450880 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:36.451355 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.451367 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.452144 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.452148 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.453059 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:36.453069 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.453648 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.453652 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:36.453800 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.454355 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:36.454371 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:36.455966 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:36.458071 (+ 2105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.458077 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.458098 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.458432 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.458730 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:36.458733 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:36.458735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:36.458874 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:36.459265 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:36.459273 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:36.459517 (+ 244us) client_negotiation.cc:769] Sending connection context
0811 04:48:36.459700 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 04:48:36.460026 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":116,"threads_started":1}
I20260811 04:48:36.462034 22122 heartbeater.cc:347] Connected to a master server at 127.17.188.126:37133
I20260811 04:48:36.462303 22122 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:36.462811 22122 heartbeater.cc:511] Master 127.17.188.126:37133 requested a full tablet report, sending...
I20260811 04:48:36.463832 21617 ts_manager.cc:194] Registered new tserver with Master: 8443a359154241068019d92e1960ecf4 (127.17.188.67:36549)
I20260811 04:48:36.464399 21617 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:58777
I20260811 04:48:36.470009 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[21566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423716, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:36.496495 21658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:36.488167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59980 (local address 127.17.188.126:37133)
0811 04:48:36.488299 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:36.488303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:36.488455 (+ 152us) server_negotiation.cc:407] Connection header received
0811 04:48:36.488629 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:36.488632 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:36.488684 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:36.488764 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:36.489456 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.490053 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.490886 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:36.491104 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:36.491185 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:36.493524 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:36.493527 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:36.493529 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:36.493554 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:36.495048 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.495438 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.495440 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.495441 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.495516 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:36.495735 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:36.495737 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:36.495738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:36.495950 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:36.496054 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:36.496264 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 04:48:36.496370 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 04:48:36.496913 21617 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:59980
I20260811 04:48:36.497881 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21686
I20260811 04:48:36.507293 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21829
I20260811 04:48:36.514344 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21982
I20260811 04:48:36.525744 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 21580
2026-08-11T04:48:36Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2198 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[22135](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[22135](info): set up 2 sockets
Aug 11 04:48:36 dist-test-slave-njxd krb5kdc[22135](info): commencing operation
krb5kdc: starting...
W20260811 04:48:37.623517 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:37 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:37.746315 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42045
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42045
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:37.854833 22151 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:37.855101 22151 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:37.855142 22151 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:37.859246 22151 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:37.859311 22151 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:37.859330 22151 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:37.859346 22151 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:37.859396 22151 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:37.864652 22151 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42045
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:37.865811 22151 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:37.866837 22151 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:37.875379 22160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:37.875387 22157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:37.875600 22151 server_base.cc:1034] running on GCE node
W20260811 04:48:37.875392 22156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:37.876245 22151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:37.877327 22151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:37.878501 22151 hybrid_clock.cc:648] HybridClock initialized: now 1786423717878455 us; error 56 us; skew 500 ppm
Aug 11 04:48:37 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423717, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:37.881182 22151 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:37.882037 22151 webserver.cc:460] Webserver started at http://127.17.188.126:33089/ using document root <none> and password file <none>
I20260811 04:48:37.882529 22151 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:37.882593 22151 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:37.882761 22151 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:37.884646 22151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0"
format_stamp: "Formatted at 2026-08-11 04:48:37 on dist-test-slave-njxd"
server_key: "a2ad09d4118e1666dfbc1cbdd5160f8a"
server_key_iv: "1a1bf00628fc074636b83b57af37295d"
server_key_version: "encryptionkey@0"
I20260811 04:48:37.885123 22151 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0"
format_stamp: "Formatted at 2026-08-11 04:48:37 on dist-test-slave-njxd"
server_key: "a2ad09d4118e1666dfbc1cbdd5160f8a"
server_key_iv: "1a1bf00628fc074636b83b57af37295d"
server_key_version: "encryptionkey@0"
I20260811 04:48:37.888715 22151 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:48:37.890899 22168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:37.892138 22151 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:37.892251 22151 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0"
format_stamp: "Formatted at 2026-08-11 04:48:37 on dist-test-slave-njxd"
server_key: "a2ad09d4118e1666dfbc1cbdd5160f8a"
server_key_iv: "1a1bf00628fc074636b83b57af37295d"
server_key_version: "encryptionkey@0"
I20260811 04:48:37.892328 22151 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:37.905901 22151 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:37.908475 22151 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:37.908618 22151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:37.915092 22151 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:42045
I20260811 04:48:37.915104 22227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:42045 every 8 connection(s)
I20260811 04:48:37.915982 22151 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:37.918635 22228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:37.922309 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22151
I20260811 04:48:37.922425 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:37.922668 18161 external_mini_cluster.cc:1428] Setting key 888723fe3ba43c4cf5963697ff3c25a0
I20260811 04:48:37.924165 22228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0: Bootstrap starting.
I20260811 04:48:37.926298 22228 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:37.927062 22228 log.cc:824] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:37.928802 22228 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0: No bootstrap required, opened a new log
Aug 11 04:48:37 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423717, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:37.932081 22228 raft_consensus.cc:348] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } }
I20260811 04:48:37.932392 22228 raft_consensus.cc:374] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:37.932468 22228 raft_consensus.cc:729] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f60aa834bdf5416ba8ae0b7eea2d70b0, State: Initialized, Role: FOLLOWER
I20260811 04:48:37.932896 22228 consensus_queue.cc:260] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } }
I20260811 04:48:37.933030 22228 raft_consensus.cc:388] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:37.933116 22228 raft_consensus.cc:482] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:37.933228 22228 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:37.934201 22228 raft_consensus.cc:504] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } }
I20260811 04:48:37.934530 22228 leader_election.cc:302] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f60aa834bdf5416ba8ae0b7eea2d70b0; no voters:
I20260811 04:48:37.934919 22228 leader_election.cc:288] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:37.935329 22235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:37.935549 22235 raft_consensus.cc:686] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [term 1 LEADER]: Becoming Leader. State: Replica: f60aa834bdf5416ba8ae0b7eea2d70b0, State: Running, Role: LEADER
I20260811 04:48:37.935907 22235 consensus_queue.cc:237] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } }
I20260811 04:48:37.936254 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:37.923957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54594 (local address 127.17.188.126:42045)
0811 04:48:37.924415 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:37.924429 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:37.924460 (+ 31us) server_negotiation.cc:407] Connection header received
0811 04:48:37.925043 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:37.925058 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:37.925381 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:37.925722 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:37.926607 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:37.927601 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:37.928427 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:37.928916 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:37.929095 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:37.931339 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:37.931344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:37.931355 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:37.931379 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:37.932983 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:37.933471 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:37.933475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:37.933479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:37.933637 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:37.933923 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:37.933925 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:37.933926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:37.934280 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:37.934446 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:37.934976 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 04:48:37.935280 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":140,"threads_started":1}
I20260811 04:48:37.936340 22228 sys_catalog.cc:564] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:37.937090 22235 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f60aa834bdf5416ba8ae0b7eea2d70b0. Latest consensus state: current_term: 1 leader_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } } }
I20260811 04:48:37.937290 22235 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:37.937515 22236 sys_catalog.cc:455] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f60aa834bdf5416ba8ae0b7eea2d70b0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42045 } } }
I20260811 04:48:37.937706 22236 sys_catalog.cc:458] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:37.938362 22244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:37.940829 22244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:37.945799 22244 catalog_manager.cc:1347] Generated new cluster ID: d9a3d243534c4939a10fc7024a55d7ca
I20260811 04:48:37.945863 22244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:37.958580 22244 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:37.959492 22244 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:37.968361 22244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f60aa834bdf5416ba8ae0b7eea2d70b0: Generated new TSK 0
I20260811 04:48:37.969000 22244 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:38.002827 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:38.115247 22256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:38.115501 22256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:38.115543 22256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:38.119607 22256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:38.119663 22256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:38.119719 22256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:38.124922 22256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:38.126040 22256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:38.127009 22256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:38.136258 22265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.136281 22263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.136354 22262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:38.136694 22256 server_base.cc:1034] running on GCE node
I20260811 04:48:38.137065 22256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:38.137776 22256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:38.138942 22256 hybrid_clock.cc:648] HybridClock initialized: now 1786423718138926 us; error 27 us; skew 500 ppm
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:38.141732 22256 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:38.142589 22256 webserver.cc:460] Webserver started at http://127.17.188.65:33325/ using document root <none> and password file <none>
I20260811 04:48:38.143134 22256 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:38.143224 22256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:38.143442 22256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:38.145381 22256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "e6f2ae0f6e71453e98d6eda2147a6798"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "d5fd275a1f407441887cf731220519a8"
server_key_iv: "82fdc5358ba09c1a5afdc148779bc3d2"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.145984 22256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "e6f2ae0f6e71453e98d6eda2147a6798"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "d5fd275a1f407441887cf731220519a8"
server_key_iv: "82fdc5358ba09c1a5afdc148779bc3d2"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.149506 22256 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:38.151777 22275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.152974 22256 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:38.153101 22256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "e6f2ae0f6e71453e98d6eda2147a6798"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "d5fd275a1f407441887cf731220519a8"
server_key_iv: "82fdc5358ba09c1a5afdc148779bc3d2"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.153204 22256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:38.165067 22256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:38.167774 22256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:38.167913 22256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:38.168396 22256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:38.169176 22256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:38.169222 22256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.169258 22256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:38.169278 22256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.178344 22256 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:39199
I20260811 04:48:38.178371 22402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:39199 every 8 connection(s)
I20260811 04:48:38.179250 22256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:38.188968 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22256
I20260811 04:48:38.189123 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:38.189424 18161 external_mini_cluster.cc:1428] Setting key ffd70d70356a5e6ba256dd1b082f3382
I20260811 04:48:38.193034 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.181073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:37919 (local address 127.17.188.126:42045)
0811 04:48:38.181221 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:38.181225 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:38.182112 (+ 887us) server_negotiation.cc:407] Connection header received
0811 04:48:38.183411 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:38.183415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:38.183462 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:38.183537 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:38.184687 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.185210 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.186326 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.186554 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.186665 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.189126 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:38.189130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:38.189132 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:38.189162 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:38.191022 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.191562 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.191566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.191568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.191656 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.191982 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.191986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.191988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.192174 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:38.192278 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:38.192738 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 04:48:38.192862 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 04:48:38.194101 22405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.181477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42045 (local address 127.17.188.65:37919)
0811 04:48:38.181965 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:38.182006 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:38.183222 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:38.183695 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:38.183701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:38.184077 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:38.184556 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.184568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.185310 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.185313 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.186230 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.186239 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.186711 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.186713 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.186846 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.187518 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:38.187535 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:38.188951 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:38.191148 (+ 2197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.191154 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.191172 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.191452 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.191746 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.191750 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.191752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.191889 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.192278 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:38.192286 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:38.192508 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 04:48:38.192694 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 04:48:38.192992 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":126,"threads_started":1}
I20260811 04:48:38.195338 22403 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42045
I20260811 04:48:38.195587 22403 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:38.196116 22403 heartbeater.cc:511] Master 127.17.188.126:42045 requested a full tablet report, sending...
I20260811 04:48:38.197553 22188 ts_manager.cc:194] Registered new tserver with Master: e6f2ae0f6e71453e98d6eda2147a6798 (127.17.188.65:39199)
I20260811 04:48:38.198688 22188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:37919
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:38.218799 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:38.332553 22408 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:38.332909 22408 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:38.332969 22408 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:38.337944 22408 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:38.338014 22408 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:38.338078 22408 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:38.343994 22408 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22408
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:38.345710 22408 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:38.346807 22408 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:38.356887 22418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.356921 22415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.356948 22416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:38.357362 22408 server_base.cc:1034] running on GCE node
I20260811 04:48:38.357908 22408 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:38.358606 22408 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:38.359813 22408 hybrid_clock.cc:648] HybridClock initialized: now 1786423718359796 us; error 40 us; skew 500 ppm
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:38.362759 22408 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:38.363637 22408 webserver.cc:460] Webserver started at http://127.17.188.66:42619/ using document root <none> and password file <none>
I20260811 04:48:38.364212 22408 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:38.364306 22408 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:38.364610 22408 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:38.366967 22408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "3bfe4e18d24b40909855b1ea83c3f5f0"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "feb06c64ae2f75279cbc5caf94cda85b"
server_key_iv: "f7a46be3bad7303cf41236fae89bb976"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.367596 22408 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "3bfe4e18d24b40909855b1ea83c3f5f0"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "feb06c64ae2f75279cbc5caf94cda85b"
server_key_iv: "f7a46be3bad7303cf41236fae89bb976"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.371371 22408 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:48:38.373886 22426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.375254 22408 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:38.375391 22408 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "3bfe4e18d24b40909855b1ea83c3f5f0"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "feb06c64ae2f75279cbc5caf94cda85b"
server_key_iv: "f7a46be3bad7303cf41236fae89bb976"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.375502 22408 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:38.408282 22408 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:38.411618 22408 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:38.411852 22408 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:38.412487 22408 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:38.413604 22408 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:38.413700 22408 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.413801 22408 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:38.413853 22408 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.422725 22408 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:46651
I20260811 04:48:38.422748 22549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:46651 every 8 connection(s)
I20260811 04:48:38.423673 22408 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:38.425750 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22408
I20260811 04:48:38.425905 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:38.426204 18161 external_mini_cluster.cc:1428] Setting key d49a464e84055f0db6967685bee78271
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:38.439849 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.425483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:35537 (local address 127.17.188.126:42045)
0811 04:48:38.425677 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:38.425683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:38.426758 (+ 1075us) server_negotiation.cc:407] Connection header received
0811 04:48:38.428527 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:38.428530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:38.428577 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:38.428657 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:38.430292 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.430833 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.432600 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.432878 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.432984 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.435719 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:38.435727 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:38.435732 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:38.435769 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:38.437529 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.438197 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.438204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.438206 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.438305 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.438715 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.438719 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.438720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.438932 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:38.439047 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:38.439538 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 04:48:38.439670 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:48:38.440714 22552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.426010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42045 (local address 127.17.188.66:35537)
0811 04:48:38.426597 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:38.426652 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:38.428279 (+ 1627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:38.428839 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:38.428852 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:38.429400 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:38.430142 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.430159 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.430961 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.430965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.432444 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.432460 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.433063 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.433071 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.433303 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.434037 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:38.434056 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:38.435536 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:38.437699 (+ 2163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.437705 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.437722 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.438060 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.438434 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.438436 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.438437 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.438598 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.439044 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:38.439051 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:38.439297 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 04:48:38.439480 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 04:48:38.439825 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":138,"threads_started":1}
I20260811 04:48:38.441951 22550 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42045
I20260811 04:48:38.442227 22550 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:38.442814 22550 heartbeater.cc:511] Master 127.17.188.126:42045 requested a full tablet report, sending...
I20260811 04:48:38.444006 22188 ts_manager.cc:194] Registered new tserver with Master: 3bfe4e18d24b40909855b1ea83c3f5f0 (127.17.188.66:46651)
I20260811 04:48:38.444614 22188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:35537
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:38.457216 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:38013
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:38.568203 22556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:38.568470 22556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:38.568512 22556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:38.572520 22556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:38.572575 22556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:38.572665 22556 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:38.578042 22556 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38013
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42045
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22556
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:38.579061 22556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:38.580101 22556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:38.589745 22561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.589731 22564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:38.589731 22562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:38.589843 22556 server_base.cc:1034] running on GCE node
I20260811 04:48:38.590375 22556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:38.591017 22556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:38.592224 22556 hybrid_clock.cc:648] HybridClock initialized: now 1786423718592208 us; error 26 us; skew 500 ppm
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:38.595224 22556 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:38.596168 22556 webserver.cc:460] Webserver started at http://127.17.188.67:42733/ using document root <none> and password file <none>
I20260811 04:48:38.596748 22556 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:38.596879 22556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:38.597117 22556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:38.599251 22556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "dc5b110a5b1b4ea8a7eea8b2c03e2aff"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "fa799461f833acabace016a406132ed7"
server_key_iv: "013c27a9a1323e73855213e56f7615bf"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.599813 22556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "dc5b110a5b1b4ea8a7eea8b2c03e2aff"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "fa799461f833acabace016a406132ed7"
server_key_iv: "013c27a9a1323e73855213e56f7615bf"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.603626 22556 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 04:48:38.606128 22571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.607394 22556 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:38.607558 22556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "dc5b110a5b1b4ea8a7eea8b2c03e2aff"
format_stamp: "Formatted at 2026-08-11 04:48:38 on dist-test-slave-njxd"
server_key: "fa799461f833acabace016a406132ed7"
server_key_iv: "013c27a9a1323e73855213e56f7615bf"
server_key_version: "encryptionkey@0"
I20260811 04:48:38.607686 22556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:38.627400 22556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:38.630218 22556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:38.630419 22556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:38.630998 22556 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:38.631803 22556 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:38.631875 22556 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.631946 22556 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:38.631999 22556 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:38.640914 22556 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44371
I20260811 04:48:38.640938 22696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44371 every 8 connection(s)
I20260811 04:48:38.641861 22556 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:38.644032 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22556
I20260811 04:48:38.644188 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:38.644477 18161 external_mini_cluster.cc:1428] Setting key d053be4bd219868186ca3c8e2c3904fd
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:38.655431 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.643628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:53417 (local address 127.17.188.126:42045)
0811 04:48:38.643764 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:38.643777 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:38.644516 (+ 739us) server_negotiation.cc:407] Connection header received
0811 04:48:38.646117 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:38.646119 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:38.646162 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:38.646219 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:38.647416 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.647948 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.649066 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.649283 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.649366 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.652045 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:38.652048 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:38.652050 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:38.652077 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:38.653623 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.654100 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.654103 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.654104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.654183 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.654482 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.654484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.654486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.654674 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:38.654750 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:38.655209 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 04:48:38.655310 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 04:48:38.656306 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.643907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42045 (local address 127.17.188.67:53417)
0811 04:48:38.644364 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:38.644416 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:38.645899 (+ 1483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:38.646386 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:38.646394 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:38.646796 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:38.647258 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.647271 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.648063 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.648065 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.648940 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:38.648949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.649415 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.649418 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:38.649559 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.650209 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:38.650225 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:38.651808 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:38.653730 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.653736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.653749 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.653998 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.654264 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:38.654266 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:38.654267 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:38.654402 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:38.654764 (+ 362us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:38.654769 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:38.655001 (+ 232us) client_negotiation.cc:769] Sending connection context
0811 04:48:38.655158 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 04:48:38.655408 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":134,"threads_started":1}
I20260811 04:48:38.657629 22697 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42045
I20260811 04:48:38.657930 22697 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:38.658454 22697 heartbeater.cc:511] Master 127.17.188.126:42045 requested a full tablet report, sending...
I20260811 04:48:38.659503 22188 ts_manager.cc:194] Registered new tserver with Master: dc5b110a5b1b4ea8a7eea8b2c03e2aff (127.17.188.67:44371)
I20260811 04:48:38.660087 22188 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:53417
I20260811 04:48:38.670331 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:38.697933 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.688355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40478 (local address 127.17.188.65:39199)
0811 04:48:38.688671 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:38.688687 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:38.688712 (+ 25us) server_negotiation.cc:407] Connection header received
0811 04:48:38.688764 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:38.688769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:38.688970 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:38.689091 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:38.689823 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.690616 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.691421 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.691776 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.691856 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.694364 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:38.694374 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:38.694387 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:38.694410 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:38.696199 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.696695 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.696700 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.696701 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.696780 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.697015 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.697017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.697018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.697239 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:38.697393 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:38.697543 (+ 150us) server_negotiation.cc:299] Negotiation successful
0811 04:48:38.697796 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":70,"threads_started":1}
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22135](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423718, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:38.708256 22232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:38.700656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54606 (local address 127.17.188.126:42045)
0811 04:48:38.700773 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:38.700776 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:38.700790 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:38.700898 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:38.700900 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:38.700942 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:38.701007 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:38.701530 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.702129 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.702835 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:38.703038 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:38.703120 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:38.705267 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:38.705270 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:38.705272 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:38.705296 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:38.706822 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.707190 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.707192 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.707193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.707267 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:38.707487 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:38.707489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:38.707490 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:38.707691 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:38.707790 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:38.707948 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 04:48:38.708035 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 04:48:38.708664 22188 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54606
I20260811 04:48:38.709314 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22256
I20260811 04:48:38.719566 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22408
I20260811 04:48:38.726408 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22556
I20260811 04:48:38.733320 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22151
2026-08-11T04:48:38Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2205 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22710](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22710](info): set up 2 sockets
Aug 11 04:48:38 dist-test-slave-njxd krb5kdc[22710](info): commencing operation
krb5kdc: starting...
W20260811 04:48:39.808821 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.051s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:39 dist-test-slave-njxd krb5kdc[22710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:39.934135 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38767
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38767
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:40.041370 22725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:40.041631 22725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:40.041672 22725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:40.045485 22725 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:40.045531 22725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:40.045550 22725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:40.045567 22725 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:40.045598 22725 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:40.050529 22725 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:40.051441 22725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:40.052731 22725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:40.060770 22731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.060851 22732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.060851 22734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:40.061026 22725 server_base.cc:1034] running on GCE node
I20260811 04:48:40.061690 22725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:40.062721 22725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:40.063910 22725 hybrid_clock.cc:648] HybridClock initialized: now 1786423720063881 us; error 41 us; skew 500 ppm
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:40.066656 22725 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:40.067399 22725 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:40.067489 22725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:40.067727 22725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:40.069907 22725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "d604be8fb522430cabac5214c0cd629a"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "55dd225b1a5aec9af050aa00088f85b0"
server_key_iv: "e2036561df47a8388d14ef2dfee431aa"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.070459 22725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "d604be8fb522430cabac5214c0cd629a"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "55dd225b1a5aec9af050aa00088f85b0"
server_key_iv: "e2036561df47a8388d14ef2dfee431aa"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.073959 22725 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:48:40.076257 22740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.077488 22725 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:40.077646 22725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "d604be8fb522430cabac5214c0cd629a"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "55dd225b1a5aec9af050aa00088f85b0"
server_key_iv: "e2036561df47a8388d14ef2dfee431aa"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.077749 22725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:40.093890 22725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:40.096585 22725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:40.096827 22725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:40.103704 22725 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:38767
I20260811 04:48:40.103956 22798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:38767 every 8 connection(s)
I20260811 04:48:40.104350 22725 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:40.107124 22799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:40.109545 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22725
I20260811 04:48:40.109704 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:40.109958 18161 external_mini_cluster.cc:1428] Setting key 7ff708713070c6b0da7a802a22a5af9a
I20260811 04:48:40.112815 22799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: Bootstrap starting.
I20260811 04:48:40.115252 22799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:40.116065 22799 log.cc:824] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:40.118064 22799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: No bootstrap required, opened a new log
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:40.121222 22799 raft_consensus.cc:348] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } }
I20260811 04:48:40.121479 22799 raft_consensus.cc:374] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:40.121559 22799 raft_consensus.cc:729] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d604be8fb522430cabac5214c0cd629a, State: Initialized, Role: FOLLOWER
I20260811 04:48:40.122045 22799 consensus_queue.cc:260] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } }
I20260811 04:48:40.122169 22799 raft_consensus.cc:388] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:40.122246 22799 raft_consensus.cc:482] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:40.122334 22799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:40.123157 22799 raft_consensus.cc:504] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } }
I20260811 04:48:40.123474 22799 leader_election.cc:302] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d604be8fb522430cabac5214c0cd629a; no voters:
I20260811 04:48:40.123735 22799 leader_election.cc:288] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:40.123828 22805 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:40.123855 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.111222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47230 (local address 127.17.188.126:38767)
0811 04:48:40.111618 (+ 396us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.111638 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.111671 (+ 33us) server_negotiation.cc:407] Connection header received
0811 04:48:40.112248 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.112262 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.112553 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.112824 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:40.113677 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.114585 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.115756 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.116247 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.116360 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.119041 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:40.119046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:40.119057 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:40.119080 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:40.121004 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.121476 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.121483 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.121490 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.121665 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.121943 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.121945 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.121946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.122402 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:40.122579 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.122808 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.123053 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":127,"threads_started":1}
I20260811 04:48:40.124045 22805 raft_consensus.cc:686] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [term 1 LEADER]: Becoming Leader. State: Replica: d604be8fb522430cabac5214c0cd629a, State: Running, Role: LEADER
I20260811 04:48:40.124336 22805 consensus_queue.cc:237] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } }
I20260811 04:48:40.124851 22799 sys_catalog.cc:564] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:40.125413 22806 sys_catalog.cc:455] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d604be8fb522430cabac5214c0cd629a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } } }
I20260811 04:48:40.125597 22806 sys_catalog.cc:458] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:40.125432 22807 sys_catalog.cc:455] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d604be8fb522430cabac5214c0cd629a. Latest consensus state: current_term: 1 leader_uuid: "d604be8fb522430cabac5214c0cd629a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d604be8fb522430cabac5214c0cd629a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38767 } } }
I20260811 04:48:40.125841 22807 sys_catalog.cc:458] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:40.125965 22811 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:40.128886 22811 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:40.134208 22811 catalog_manager.cc:1347] Generated new cluster ID: e64672889666438484753250ffc07aaa
I20260811 04:48:40.134276 22811 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:40.140985 22811 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:40.142423 22811 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:40.149442 22811 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: Generated new TSK 0
I20260811 04:48:40.150184 22811 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:40.177912 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:40.289438 22828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:40.289803 22828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:40.289876 22828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:40.294516 22828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:40.294600 22828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:40.294693 22828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:40.300143 22828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:40.301223 22828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:40.302302 22828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:40.311866 22828 server_base.cc:1034] running on GCE node
W20260811 04:48:40.311794 22837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.311784 22835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.311777 22834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:40.312547 22828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:40.313189 22828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:40.314347 22828 hybrid_clock.cc:648] HybridClock initialized: now 1786423720314326 us; error 42 us; skew 500 ppm
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:40.317219 22828 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:40.317965 22828 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:40.318024 22828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:40.318213 22828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:40.320192 22828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "4449f69869c640a2a1d7263692b1bcb7"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "026ff0090735e51b15c59d1172d95ac4"
server_key_iv: "f6e099eaed2022bfea989a93d556f07a"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.320706 22828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "4449f69869c640a2a1d7263692b1bcb7"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "026ff0090735e51b15c59d1172d95ac4"
server_key_iv: "f6e099eaed2022bfea989a93d556f07a"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.324510 22828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 04:48:40.327100 22843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.328330 22828 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:40.328424 22828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "4449f69869c640a2a1d7263692b1bcb7"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "026ff0090735e51b15c59d1172d95ac4"
server_key_iv: "f6e099eaed2022bfea989a93d556f07a"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.328555 22828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:40.348847 22828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:40.352222 22828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:40.352427 22828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:40.353036 22828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:40.353878 22828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:40.353947 22828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.354022 22828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:40.354063 22828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.362812 22828 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:42319
I20260811 04:48:40.362893 22969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:42319 every 8 connection(s)
I20260811 04:48:40.363462 22828 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:40.364337 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22828
I20260811 04:48:40.364487 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:40.364789 18161 external_mini_cluster.cc:1428] Setting key 2845da232d1fcf313fefb73b58f370ee
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:40.379540 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.365429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:48181 (local address 127.17.188.126:38767)
0811 04:48:40.365627 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.365631 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.366652 (+ 1021us) server_negotiation.cc:407] Connection header received
0811 04:48:40.368604 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.368609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.368672 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.368772 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:40.370068 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.370602 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.372482 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.372703 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.372806 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.375789 (+ 2983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:40.375792 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:40.375794 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:40.375817 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:40.377386 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.377959 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.377962 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.377963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.378039 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.378384 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.378387 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.378389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.378613 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:40.378722 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.379216 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.379366 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 04:48:40.380329 22972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.365937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38767 (local address 127.17.188.65:48181)
0811 04:48:40.366479 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.366550 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.368326 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.368928 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.368934 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.369286 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:40.369906 (+ 620us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.369930 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.370735 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.370742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.372354 (+ 1612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.372369 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.372889 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.372895 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.373160 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.373856 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:40.373882 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:40.375610 (+ 1728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:40.377515 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.377520 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.377534 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.377841 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.378139 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.378142 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.378144 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.378282 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.378717 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:40.378723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:40.378977 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.379155 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.379483 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
I20260811 04:48:40.381698 22970 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38767
I20260811 04:48:40.381947 22970 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:40.382511 22970 heartbeater.cc:511] Master 127.17.188.126:38767 requested a full tablet report, sending...
I20260811 04:48:40.384186 22760 ts_manager.cc:194] Registered new tserver with Master: 4449f69869c640a2a1d7263692b1bcb7 (127.17.188.65:42319)
I20260811 04:48:40.385439 22760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:48181
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:40.396776 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:40.507411 22977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:40.507665 22977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:40.507709 22977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:40.511708 22977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:40.511759 22977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:40.511849 22977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:40.516984 22977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:40.517982 22977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:40.518960 22977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:40.528313 22985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.528337 22982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.528317 22983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:40.528657 22977 server_base.cc:1034] running on GCE node
I20260811 04:48:40.529031 22977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:40.529666 22977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:40.530867 22977 hybrid_clock.cc:648] HybridClock initialized: now 1786423720530833 us; error 49 us; skew 500 ppm
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:40.533855 22977 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:40.534540 22977 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:40.534649 22977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:40.534873 22977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:40.536832 22977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "3d08990c259b478088ae0d7459defa66"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "604acae1bef3b2becf388bdd50429c92"
server_key_iv: "3078a3fd8556f212600569a82054f1bd"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.537380 22977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "3d08990c259b478088ae0d7459defa66"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "604acae1bef3b2becf388bdd50429c92"
server_key_iv: "3078a3fd8556f212600569a82054f1bd"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.540817 22977 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:48:40.543160 22992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.544324 22977 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:40.544453 22977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "3d08990c259b478088ae0d7459defa66"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "604acae1bef3b2becf388bdd50429c92"
server_key_iv: "3078a3fd8556f212600569a82054f1bd"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.544559 22977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:40.566092 22977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:40.569115 22977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:40.569300 22977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:40.569890 22977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:40.570751 22977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:40.570827 22977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.570889 22977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:40.570923 22977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.579908 22977 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:33369
I20260811 04:48:40.579928 23119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:33369 every 8 connection(s)
I20260811 04:48:40.580439 22977 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:40.583142 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 22977
I20260811 04:48:40.583271 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:40.583603 18161 external_mini_cluster.cc:1428] Setting key 4a60e0cb94d99894e512a1f77a68b6b8
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:40.595173 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.582167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:34007 (local address 127.17.188.126:38767)
0811 04:48:40.582358 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.582363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.583306 (+ 943us) server_negotiation.cc:407] Connection header received
0811 04:48:40.584796 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.584801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.584849 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.584961 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:40.586525 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.587407 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.588584 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.588818 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.588930 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.591510 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:40.591513 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:40.591515 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:40.591539 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:40.592957 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.593473 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.593481 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.593483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.593559 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.594026 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.594030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.594032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.594222 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:40.594335 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.594932 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.595041 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 04:48:40.596108 23122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.582648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38767 (local address 127.17.188.66:34007)
0811 04:48:40.583153 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.583209 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.584588 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.585132 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.585139 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.585761 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:40.586360 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.586379 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.587555 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.587559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.588446 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.588456 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.588982 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.588986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.589158 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.589825 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:40.589842 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:40.591343 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:40.593078 (+ 1735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.593084 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.593099 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.593359 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.593708 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.593711 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.593714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.593922 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.594381 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:40.594389 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:40.594710 (+ 321us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.594887 (+ 177us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.595146 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:48:40.597417 23120 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38767
I20260811 04:48:40.597729 23120 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:40.598272 23120 heartbeater.cc:511] Master 127.17.188.126:38767 requested a full tablet report, sending...
I20260811 04:48:40.599447 22760 ts_manager.cc:194] Registered new tserver with Master: 3d08990c259b478088ae0d7459defa66 (127.17.188.66:33369)
I20260811 04:48:40.600047 22760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:34007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:40.612957 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:40.725739 23126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:40.725973 23126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:40.726017 23126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:40.730199 23126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:40.730255 23126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:40.730314 23126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:40.735548 23126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38767
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:40.736497 23126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:40.737461 23126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:40.747071 23135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.747126 23132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:40.747066 23133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:40.747439 23126 server_base.cc:1034] running on GCE node
I20260811 04:48:40.747831 23126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:40.748467 23126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:40.749665 23126 hybrid_clock.cc:648] HybridClock initialized: now 1786423720749626 us; error 41 us; skew 500 ppm
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:40.752393 23126 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:40.753140 23126 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:40.753232 23126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:40.753470 23126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:40.755512 23126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "47b90d39d18346978c3e7fd13b716d0c"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "478a522e90e1c345fb52cad16b5d44ad"
server_key_iv: "57def2dc14b30809a8e29a9c40d2a9d7"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.756085 23126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "47b90d39d18346978c3e7fd13b716d0c"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "478a522e90e1c345fb52cad16b5d44ad"
server_key_iv: "57def2dc14b30809a8e29a9c40d2a9d7"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.759740 23126 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:48:40.761976 23141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.763137 23126 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:40.763262 23126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "47b90d39d18346978c3e7fd13b716d0c"
format_stamp: "Formatted at 2026-08-11 04:48:40 on dist-test-slave-njxd"
server_key: "478a522e90e1c345fb52cad16b5d44ad"
server_key_iv: "57def2dc14b30809a8e29a9c40d2a9d7"
server_key_version: "encryptionkey@0"
I20260811 04:48:40.763362 23126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:40.787680 23126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:40.790978 23126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:40.791181 23126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:40.791746 23126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:40.792539 23126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:40.792620 23126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.792692 23126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:40.792737 23126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:40.801842 23126 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44373
I20260811 04:48:40.801869 23266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44373 every 8 connection(s)
I20260811 04:48:40.802400 23126 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:40.809767 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23126
I20260811 04:48:40.809921 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:40.810230 18161 external_mini_cluster.cc:1428] Setting key 6da07804bacbe96fd178e0fb41776e87
Aug 11 04:48:40 dist-test-slave-njxd krb5kdc[22710](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423720, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:40.815295 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.803990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56387 (local address 127.17.188.126:38767)
0811 04:48:40.804169 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.804174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.805331 (+ 1157us) server_negotiation.cc:407] Connection header received
0811 04:48:40.806203 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.806205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.806253 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.806328 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:40.807433 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.807920 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.808978 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.809209 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.809291 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.812199 (+ 2908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:40.812202 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:40.812206 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:40.812233 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:40.813394 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.813954 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.813956 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.813958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.814035 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.814368 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.814370 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.814371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.814536 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:40.814632 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.815068 (+ 436us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.815179 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:48:40.816246 23269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.804413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38767 (local address 127.17.188.67:56387)
0811 04:48:40.805197 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.805235 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.806021 (+ 786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.806481 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.806488 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.806850 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:40.807283 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.807294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.808038 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.808040 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.808861 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.808869 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.809333 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.809336 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.809467 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.810317 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:40.810344 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:40.812000 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:40.813494 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.813499 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.813510 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.813838 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.814127 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:40.814129 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:40.814131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:40.814260 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:40.814638 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:40.814642 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:40.814856 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.815005 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.815463 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":113,"threads_started":1}
I20260811 04:48:40.817286 23267 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38767
I20260811 04:48:40.817513 23267 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:40.817970 23267 heartbeater.cc:511] Master 127.17.188.126:38767 requested a full tablet report, sending...
I20260811 04:48:40.818964 22760 ts_manager.cc:194] Registered new tserver with Master: 47b90d39d18346978c3e7fd13b716d0c (127.17.188.67:44373)
I20260811 04:48:40.819519 22760 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:56387
I20260811 04:48:40.823858 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:48:40.833245 22803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.826003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47238 (local address 127.17.188.126:38767)
0811 04:48:40.826123 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.826126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.826307 (+ 181us) server_negotiation.cc:407] Connection header received
0811 04:48:40.826411 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.826413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.826456 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.826553 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:40.827302 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.827798 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.828976 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.829282 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.829356 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.830518 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:40.830520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:40.830522 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:40.830542 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:40.831909 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.832276 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.832279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.832280 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.832348 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:40.832572 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:40.832573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:40.832574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:40.832752 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:40.832847 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.832996 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.833115 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:40.835894 22760 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:40.838938 22760 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:40.853286 23278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42319 (local address 127.0.0.1:56696)
0811 04:48:40.847973 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.848020 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.848153 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.848939 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.848944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.848966 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:40.849091 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.849100 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850497 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.850502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.851944 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.851956 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.852750 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.852754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.852859 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.852892 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.853031 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.853146 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":98,"threads_started":1}
I20260811 04:48:40.853468 23281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:33369 (local address 127.0.0.1:41972)
0811 04:48:40.848283 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.848296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.848368 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.849663 (+ 1295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.849666 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.849688 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:40.849772 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.849778 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850950 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.850954 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.852002 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.852031 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.853043 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.853046 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.853119 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.853138 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.853191 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.853241 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":946,"mutex_wait_us":29,"thread_start_us":105,"threads_started":1}
I20260811 04:48:40.853668 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56696 (local address 127.17.188.65:42319)
0811 04:48:40.848119 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.848126 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.848149 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:48:40.848353 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.848358 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.848569 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.848726 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:40.849239 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850352 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.852078 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.852627 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.852750 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.852892 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.853353 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.853446 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":90,"threads_started":1}
I20260811 04:48:40.853928 23282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.17.188.66:33369)
0811 04:48:40.848939 (+ 988us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.848948 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.848966 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:48:40.849071 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.849076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.849272 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.849467 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:40.849902 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850817 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.852139 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.852923 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.853043 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.853171 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.853223 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.853303 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":138,"threads_started":1}
I20260811 04:48:40.854022 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44373 (local address 127.0.0.1:34882)
0811 04:48:40.848519 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.848530 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.848701 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.849374 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.849377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.849393 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:40.849481 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.849486 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850650 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.850653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.851999 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.852009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.853668 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.853672 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.853757 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.853780 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.853851 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.853912 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":70,"thread_start_us":110,"threads_started":1}
I20260811 04:48:40.854350 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.847992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34882 (local address 127.17.188.67:44373)
0811 04:48:40.848452 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.848465 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.848635 (+ 170us) server_negotiation.cc:407] Connection header received
0811 04:48:40.848872 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.848878 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.849054 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.849215 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:40.849634 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.850486 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.852139 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.852923 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.853051 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.853171 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.853880 (+ 709us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.853964 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":149,"threads_started":1}
I20260811 04:48:40.856364 23045 tablet_service.cc:1467] Processing CreateTablet for tablet 697ce18cafc94b0396e3b36b375db173 (DEFAULT_TABLE table=test-table [id=14c79e77db384cca8603c2fe4222f840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:40.857295 23045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697ce18cafc94b0396e3b36b375db173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:40.857023 22896 tablet_service.cc:1467] Processing CreateTablet for tablet 697ce18cafc94b0396e3b36b375db173 (DEFAULT_TABLE table=test-table [id=14c79e77db384cca8603c2fe4222f840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:40.857023 23194 tablet_service.cc:1467] Processing CreateTablet for tablet 697ce18cafc94b0396e3b36b375db173 (DEFAULT_TABLE table=test-table [id=14c79e77db384cca8603c2fe4222f840]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:40.858018 22896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697ce18cafc94b0396e3b36b375db173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:40.858029 23194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 697ce18cafc94b0396e3b36b375db173. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:40.863519 23284 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Bootstrap starting.
I20260811 04:48:40.864871 23287 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Bootstrap starting.
I20260811 04:48:40.865672 23285 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: Bootstrap starting.
I20260811 04:48:40.865918 23284 tablet_bootstrap.cc:654] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:40.867105 23287 tablet_bootstrap.cc:654] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:40.867219 23284 log.cc:824] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:40.867597 23285 tablet_bootstrap.cc:654] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:40.868217 23287 log.cc:824] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:40.868745 23285 log.cc:824] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:40.869419 23284 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: No bootstrap required, opened a new log
I20260811 04:48:40.869660 23284 ts_tablet_manager.cc:1397] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:48:40.870203 23287 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: No bootstrap required, opened a new log
I20260811 04:48:40.870396 23287 ts_tablet_manager.cc:1397] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:48:40.870618 23285 tablet_bootstrap.cc:492] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: No bootstrap required, opened a new log
I20260811 04:48:40.870798 23285 ts_tablet_manager.cc:1397] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:40.873459 23285 raft_consensus.cc:348] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.873522 23284 raft_consensus.cc:348] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.873760 23285 raft_consensus.cc:374] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:40.873814 23285 raft_consensus.cc:729] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4449f69869c640a2a1d7263692b1bcb7, State: Initialized, Role: FOLLOWER
I20260811 04:48:40.873814 23284 raft_consensus.cc:374] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:40.873869 23284 raft_consensus.cc:729] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d08990c259b478088ae0d7459defa66, State: Initialized, Role: FOLLOWER
I20260811 04:48:40.874037 23287 raft_consensus.cc:348] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.874349 23287 raft_consensus.cc:374] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:40.874267 23285 consensus_queue.cc:260] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.874280 23284 consensus_queue.cc:260] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.874401 23287 raft_consensus.cc:729] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b90d39d18346978c3e7fd13b716d0c, State: Initialized, Role: FOLLOWER
I20260811 04:48:40.874792 23287 consensus_queue.cc:260] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.875034 23120 heartbeater.cc:503] Master 127.17.188.126:38767 was elected leader, sending a full tablet report...
I20260811 04:48:40.875279 23284 ts_tablet_manager.cc:1428] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:48:40.875301 23285 ts_tablet_manager.cc:1428] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:40.876010 22970 heartbeater.cc:503] Master 127.17.188.126:38767 was elected leader, sending a full tablet report...
I20260811 04:48:40.876187 23287 ts_tablet_manager.cc:1428] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:48:40.876470 23267 heartbeater.cc:503] Master 127.17.188.126:38767 was elected leader, sending a full tablet report...
I20260811 04:48:40.983393 23293 raft_consensus.cc:482] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:40.983664 23293 raft_consensus.cc:504] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.984884 23293 leader_election.cc:288] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4449f69869c640a2a1d7263692b1bcb7 (127.17.188.65:42319), 3d08990c259b478088ae0d7459defa66 (127.17.188.66:33369)
I20260811 04:48:40.989470 23282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.985324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:46857 (local address 127.17.188.66:33369)
0811 04:48:40.985484 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.985491 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.985510 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:48:40.985621 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.985630 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.985674 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.985741 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:40.986111 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.986737 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.988380 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.988961 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.989081 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.989134 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.989285 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.989357 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 04:48:40.989493 23269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.985169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:33369 (local address 127.17.188.67:46857)
0811 04:48:40.985330 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.985347 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.985455 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.985784 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.985790 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.985816 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:40.985975 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.985981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.986901 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.986906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.988256 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.988267 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.989081 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.989084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.989162 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.989182 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.989243 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.989336 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":24,"spinlock_wait_cycles":1920}
I20260811 04:48:40.989753 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.985169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42319 (local address 127.17.188.67:45061)
0811 04:48:40.985743 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:40.985756 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:40.985858 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:40.986070 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:40.986075 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:40.986096 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:40.986207 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.986230 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.987315 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.987318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.988459 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:40.988467 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.989330 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.989333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:40.989417 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.989437 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 04:48:40.989511 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:48:40.989604 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":142,"thread_start_us":145,"threads_started":1}
I20260811 04:48:40.989781 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:40.985307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:45061 (local address 127.17.188.65:42319)
0811 04:48:40.985426 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:40.985431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:40.985867 (+ 436us) server_negotiation.cc:407] Connection header received
0811 04:48:40.985934 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:40.985936 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:40.985977 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:40.986032 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:40.986376 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.987148 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.988582 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:40.989193 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:40.989324 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:40.989367 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:40.989543 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 04:48:40.989653 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:48:40.990525 22921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697ce18cafc94b0396e3b36b375db173" candidate_uuid: "47b90d39d18346978c3e7fd13b716d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4449f69869c640a2a1d7263692b1bcb7" is_pre_election: true
I20260811 04:48:40.990521 23070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697ce18cafc94b0396e3b36b375db173" candidate_uuid: "47b90d39d18346978c3e7fd13b716d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d08990c259b478088ae0d7459defa66" is_pre_election: true
I20260811 04:48:40.990859 23070 raft_consensus.cc:2454] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b90d39d18346978c3e7fd13b716d0c in term 0.
I20260811 04:48:40.990859 22921 raft_consensus.cc:2454] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b90d39d18346978c3e7fd13b716d0c in term 0.
I20260811 04:48:40.991431 23144 leader_election.cc:302] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3d08990c259b478088ae0d7459defa66, 4449f69869c640a2a1d7263692b1bcb7, 47b90d39d18346978c3e7fd13b716d0c; no voters:
I20260811 04:48:40.991750 23293 raft_consensus.cc:2781] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:40.991856 23293 raft_consensus.cc:482] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:40.991936 23293 raft_consensus.cc:3037] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:40.993047 23293 raft_consensus.cc:504] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:40.993412 23293 leader_election.cc:288] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [CANDIDATE]: Term 1 election: Requested vote from peers 4449f69869c640a2a1d7263692b1bcb7 (127.17.188.65:42319), 3d08990c259b478088ae0d7459defa66 (127.17.188.66:33369)
I20260811 04:48:40.993846 22921 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697ce18cafc94b0396e3b36b375db173" candidate_uuid: "47b90d39d18346978c3e7fd13b716d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4449f69869c640a2a1d7263692b1bcb7"
I20260811 04:48:40.993836 23070 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "697ce18cafc94b0396e3b36b375db173" candidate_uuid: "47b90d39d18346978c3e7fd13b716d0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d08990c259b478088ae0d7459defa66"
I20260811 04:48:40.993975 22921 raft_consensus.cc:3037] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:40.993975 23070 raft_consensus.cc:3037] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:40.995334 22921 raft_consensus.cc:2454] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b90d39d18346978c3e7fd13b716d0c in term 1.
I20260811 04:48:40.995334 23070 raft_consensus.cc:2454] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b90d39d18346978c3e7fd13b716d0c in term 1.
I20260811 04:48:40.995664 23144 leader_election.cc:302] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4449f69869c640a2a1d7263692b1bcb7, 47b90d39d18346978c3e7fd13b716d0c; no voters:
I20260811 04:48:40.995829 23293 raft_consensus.cc:2781] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:40.996088 23293 raft_consensus.cc:686] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 1 LEADER]: Becoming Leader. State: Replica: 47b90d39d18346978c3e7fd13b716d0c, State: Running, Role: LEADER
I20260811 04:48:40.996421 23293 consensus_queue.cc:237] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } }
I20260811 04:48:41.000149 22758 catalog_manager.cc:5495] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b90d39d18346978c3e7fd13b716d0c (127.17.188.67). New cstate: current_term: 1 leader_uuid: "47b90d39d18346978c3e7fd13b716d0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b90d39d18346978c3e7fd13b716d0c" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44373 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:41.040582 23283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.037031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34890 (local address 127.17.188.67:44373)
0811 04:48:41.037192 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.037198 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.037215 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:48:41.037305 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.037307 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.037359 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.037470 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:41.037783 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:41.038285 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:41.039164 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:41.039385 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:41.039493 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:41.039803 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:41.040203 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:41.040330 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.040367 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.040420 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 04:48:41.046321 22921 raft_consensus.cc:1261] T 697ce18cafc94b0396e3b36b375db173 P 4449f69869c640a2a1d7263692b1bcb7 [term 1 FOLLOWER]: Refusing update from remote peer 47b90d39d18346978c3e7fd13b716d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:41.046322 23070 raft_consensus.cc:1261] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 1 FOLLOWER]: Refusing update from remote peer 47b90d39d18346978c3e7fd13b716d0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:41.047032 23296 consensus_queue.cc:1035] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4449f69869c640a2a1d7263692b1bcb7" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:41.047222 23293 consensus_queue.cc:1035] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d08990c259b478088ae0d7459defa66" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 33369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 04:48:41.053191 23268 tablet.cc:2369] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:41.057698 23300 mvcc.cc:205] Tried to move back new op lower bound from 7317191561398824960 to 7317191561204011008. Current Snapshot: MvccSnapshot[applied={T|T < 7317191561398824960}]
I20260811 04:48:41.063004 22758 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:41.063169 22758 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:41.065371 22758 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d604be8fb522430cabac5214c0cd629a: Sending DeleteTablet for 3 replicas of tablet 697ce18cafc94b0396e3b36b375db173
I20260811 04:48:41.066120 23045 tablet_service.cc:1514] Processing DeleteTablet for tablet 697ce18cafc94b0396e3b36b375db173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:41972
I20260811 04:48:41.066172 22896 tablet_service.cc:1514] Processing DeleteTablet for tablet 697ce18cafc94b0396e3b36b375db173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:56696
I20260811 04:48:41.066612 23310 tablet_replica.cc:330] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: stopping tablet replica
I20260811 04:48:41.066900 23194 tablet_service.cc:1514] Processing DeleteTablet for tablet 697ce18cafc94b0396e3b36b375db173 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:34882
I20260811 04:48:41.066943 23310 raft_consensus.cc:2229] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:41.067298 23311 tablet_replica.cc:330] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: stopping tablet replica
I20260811 04:48:41.067427 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22828
I20260811 04:48:41.067561 23310 raft_consensus.cc:2258] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:41.074922 23311 raft_consensus.cc:2229] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:41.075141 23310 ts_tablet_manager.cc:1905] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:41.075263 23311 raft_consensus.cc:2258] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:41.077718 23311 ts_tablet_manager.cc:1905] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:41.078266 23310 ts_tablet_manager.cc:1918] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:41.078418 23310 log.cc:1196] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/697ce18cafc94b0396e3b36b375db173
I20260811 04:48:41.078805 23310 ts_tablet_manager.cc:1939] T 697ce18cafc94b0396e3b36b375db173 P 3d08990c259b478088ae0d7459defa66: Deleting consensus metadata
I20260811 04:48:41.080112 22745 catalog_manager.cc:4841] TS 3d08990c259b478088ae0d7459defa66 (127.17.188.66:33369): tablet 697ce18cafc94b0396e3b36b375db173 (table test-table [id=14c79e77db384cca8603c2fe4222f840]) successfully deleted
I20260811 04:48:41.080855 23311 ts_tablet_manager.cc:1918] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:41.080973 23311 log.cc:1196] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/697ce18cafc94b0396e3b36b375db173
I20260811 04:48:41.081279 23311 ts_tablet_manager.cc:1939] T 697ce18cafc94b0396e3b36b375db173 P 47b90d39d18346978c3e7fd13b716d0c: Deleting consensus metadata
I20260811 04:48:41.082278 22741 catalog_manager.cc:4841] TS 47b90d39d18346978c3e7fd13b716d0c (127.17.188.67:44373): tablet 697ce18cafc94b0396e3b36b375db173 (table test-table [id=14c79e77db384cca8603c2fe4222f840]) successfully deleted
W20260811 04:48:41.085955 22743 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:42319 (error 108)
I20260811 04:48:41.086124 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22977
I20260811 04:48:41.089013 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.088654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42319 (local address 127.0.0.1:56700)
0811 04:48:41.088833 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.088910 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:42319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 04:48:41.089293 22743 catalog_manager.cc:4584] TS 4449f69869c640a2a1d7263692b1bcb7 (127.17.188.65:42319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 697ce18cafc94b0396e3b36b375db173: Network error: Client connection negotiation failed: client connection to 127.17.188.65:42319: connect: Connection refused (error 111)
I20260811 04:48:41.094856 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23126
I20260811 04:48:41.101019 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 22725
2026-08-11T04:48:41Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2366 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T04:48:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:41Z Disabled control of system clock
I20260811 04:48:41.132490 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41653
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 04:48:41.239494 23316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:41.239725 23316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:41.239759 23316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:41.243398 23316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:41.243441 23316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:41.243455 23316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:41.243471 23316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:41.243485 23316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:41.248032 23316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41653
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:41.248953 23316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:41.250200 23316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:41.258412 23323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.258404 23324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.258433 23327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:41.258785 23316 server_base.cc:1034] running on GCE node
I20260811 04:48:41.259266 23316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:41.260213 23316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:41.261394 23316 hybrid_clock.cc:648] HybridClock initialized: now 1786423721261367 us; error 38 us; skew 500 ppm
I20260811 04:48:41.267208 23316 webserver.cc:460] Webserver started at http://127.17.188.126:42301/ using document root <none> and password file <none>
I20260811 04:48:41.267823 23316 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:41.267911 23316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:41.268148 23316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:41.270215 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "ab4251741b934d529679eed96e9f1fc7"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "f5f3e4f64987e783eca4fe29751cbfe1"
server_key_iv: "45f7e9ec99f42ec47fbecd38996e8489"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.270758 23316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "ab4251741b934d529679eed96e9f1fc7"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "f5f3e4f64987e783eca4fe29751cbfe1"
server_key_iv: "45f7e9ec99f42ec47fbecd38996e8489"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.274361 23316 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:41.276651 23333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.277848 23316 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:41.277987 23316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "ab4251741b934d529679eed96e9f1fc7"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "f5f3e4f64987e783eca4fe29751cbfe1"
server_key_iv: "45f7e9ec99f42ec47fbecd38996e8489"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.278102 23316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:41.282663 23316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:41.283254 23316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:41.283430 23316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:41.290330 23316 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:41653
I20260811 04:48:41.290360 23391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:41653 every 8 connection(s)
I20260811 04:48:41.291177 23316 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:41.295133 23392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:41.298079 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23316
I20260811 04:48:41.298221 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:41.298488 18161 external_mini_cluster.cc:1428] Setting key dfd9cedc63adcda9c68ed4035f3695cb
I20260811 04:48:41.300722 23392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: Bootstrap starting.
I20260811 04:48:41.303313 23392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:41.303894 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.299882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53816 (local address 127.17.188.126:41653)
0811 04:48:41.300448 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.300463 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.300494 (+ 31us) server_negotiation.cc:407] Connection header received
0811 04:48:41.301113 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.301130 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.301476 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.301809 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.302615 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.302619 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.302630 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.302639 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.302691 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.302706 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.302819 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.302978 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.303237 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":124,"threads_started":1}
I20260811 04:48:41.304100 23392 log.cc:824] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:41.305989 23392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: No bootstrap required, opened a new log
I20260811 04:48:41.309275 23392 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } }
I20260811 04:48:41.309466 23392 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:41.309497 23392 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4251741b934d529679eed96e9f1fc7, State: Initialized, Role: FOLLOWER
I20260811 04:48:41.309877 23392 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } }
I20260811 04:48:41.309990 23392 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:41.310031 23392 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:41.310096 23392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:41.310864 23392 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } }
I20260811 04:48:41.311211 23392 leader_election.cc:302] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab4251741b934d529679eed96e9f1fc7; no voters:
I20260811 04:48:41.311524 23392 leader_election.cc:288] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:41.311578 23397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:41.311851 23397 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [term 1 LEADER]: Becoming Leader. State: Replica: ab4251741b934d529679eed96e9f1fc7, State: Running, Role: LEADER
I20260811 04:48:41.312129 23397 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } }
I20260811 04:48:41.312680 23392 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:41.313675 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab4251741b934d529679eed96e9f1fc7. Latest consensus state: current_term: 1 leader_uuid: "ab4251741b934d529679eed96e9f1fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } } }
I20260811 04:48:41.313804 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:41.314082 23398 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab4251741b934d529679eed96e9f1fc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab4251741b934d529679eed96e9f1fc7" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41653 } } }
I20260811 04:48:41.314177 23398 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:41.314281 23406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:41.316792 23406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:41.322033 23406 catalog_manager.cc:1347] Generated new cluster ID: 6b44ffe166314b8db88e3574a0b5a624
I20260811 04:48:41.322098 23406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:41.330118 23406 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:41.330385 23406 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:41.341925 23406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: Generated new TSK 0
I20260811 04:48:41.342561 23406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:48:41.349718 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--builtin_ntp_servers=127.17.188.84:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 04:48:41.462003 23418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:41.462244 23418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:41.462316 23418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:41.466410 23418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:41.466456 23418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:41.466538 23418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:41.471246 23418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:41.472296 23418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:41.473753 23418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:41.483428 23429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.483440 23425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.483433 23426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:41.483564 23418 server_base.cc:1034] running on GCE node
I20260811 04:48:41.484223 23418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:41.484915 23418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:41.486083 23418 hybrid_clock.cc:648] HybridClock initialized: now 1786423721486049 us; error 48 us; skew 500 ppm
I20260811 04:48:41.488006 23418 webserver.cc:460] Webserver started at http://127.17.188.65:41365/ using document root <none> and password file <none>
I20260811 04:48:41.488627 23418 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:41.488689 23418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:41.488946 23418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:41.491093 23418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "5571a1121d5440b69a9cf2ead30f4710"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "dee574506968f19fabb031541e7744a7"
server_key_iv: "015b155f7375d69e816602bea9213b65"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.491664 23418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "5571a1121d5440b69a9cf2ead30f4710"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "dee574506968f19fabb031541e7744a7"
server_key_iv: "015b155f7375d69e816602bea9213b65"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.495358 23418 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:48:41.497949 23436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.499162 23418 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:41.499315 23418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "5571a1121d5440b69a9cf2ead30f4710"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "dee574506968f19fabb031541e7744a7"
server_key_iv: "015b155f7375d69e816602bea9213b65"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.499433 23418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:41.504127 23418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:41.504757 23418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:41.504945 23418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:41.505524 23418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:41.506471 23418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:41.506542 23418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.506631 23418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:41.506682 23418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.515661 23418 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:41997
I20260811 04:48:41.515693 23557 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:41997 every 8 connection(s)
I20260811 04:48:41.516606 23418 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:41.522742 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.518538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35601 (local address 127.17.188.126:41653)
0811 04:48:41.518695 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.518701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.519840 (+ 1139us) server_negotiation.cc:407] Connection header received
0811 04:48:41.521114 (+ 1274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.521116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.521154 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.521229 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.522337 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.522340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.522342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.522354 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.522374 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.522381 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.522461 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.522586 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.522629 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:48:41.523653 23560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.519008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41653 (local address 127.17.188.65:35601)
0811 04:48:41.519678 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.519720 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.520914 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.521365 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.521372 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.521464 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.522038 (+ 574us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.522039 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.522083 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.522182 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.522459 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.522465 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.522470 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.522606 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.522834 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":119,"threads_started":1}
I20260811 04:48:41.524916 23558 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41653
I20260811 04:48:41.525168 23558 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:41.525614 23558 heartbeater.cc:511] Master 127.17.188.126:41653 requested a full tablet report, sending...
I20260811 04:48:41.526394 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23418
I20260811 04:48:41.526535 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:41.526816 18161 external_mini_cluster.cc:1428] Setting key f4cf5e7a4342dbb5819a1b7e345d6e8d
I20260811 04:48:41.527245 23354 ts_manager.cc:194] Registered new tserver with Master: 5571a1121d5440b69a9cf2ead30f4710 (127.17.188.65:41997)
I20260811 04:48:41.528851 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--builtin_ntp_servers=127.17.188.84:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 04:48:41.639654 23561 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:41.639963 23561 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:41.640035 23561 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:41.644264 23561 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:41.644358 23561 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:41.644449 23561 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:41.649297 23561 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23561
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:41.650446 23561 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:41.651870 23561 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:41.661455 23570 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.661455 23566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.661463 23567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:41.661773 23561 server_base.cc:1034] running on GCE node
I20260811 04:48:41.662240 23561 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:41.662881 23561 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:41.664075 23561 hybrid_clock.cc:648] HybridClock initialized: now 1786423721664044 us; error 49 us; skew 500 ppm
I20260811 04:48:41.666091 23561 webserver.cc:460] Webserver started at http://127.17.188.66:36047/ using document root <none> and password file <none>
I20260811 04:48:41.666697 23561 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:41.666788 23561 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:41.667028 23561 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:41.669196 23561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "ae67ab8ed46646af9a1e74002c85dcf9"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "4c3311d5027f0dd552f125326cc35a5e"
server_key_iv: "49147ebb020e5a5af613e7a83ae2317e"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.669826 23561 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "ae67ab8ed46646af9a1e74002c85dcf9"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "4c3311d5027f0dd552f125326cc35a5e"
server_key_iv: "49147ebb020e5a5af613e7a83ae2317e"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.673452 23561 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:41.675978 23576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.677198 23561 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:41.677331 23561 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "ae67ab8ed46646af9a1e74002c85dcf9"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "4c3311d5027f0dd552f125326cc35a5e"
server_key_iv: "49147ebb020e5a5af613e7a83ae2317e"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.677441 23561 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:41.682344 23561 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:41.682979 23561 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:41.683169 23561 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:41.683713 23561 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:41.684607 23561 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:41.684676 23561 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.684741 23561 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:41.684790 23561 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.694003 23561 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38889
I20260811 04:48:41.694023 23699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38889 every 8 connection(s)
I20260811 04:48:41.694933 23561 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:41.695467 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23561
I20260811 04:48:41.695598 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:41.695911 18161 external_mini_cluster.cc:1428] Setting key 66193bff285527ff78db0f1846e97074
I20260811 04:48:41.698213 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--builtin_ntp_servers=127.17.188.84:35391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 04:48:41.701668 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.697082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:60603 (local address 127.17.188.126:41653)
0811 04:48:41.697222 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.697227 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.698635 (+ 1408us) server_negotiation.cc:407] Connection header received
0811 04:48:41.699949 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.699952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.699997 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.700097 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.701184 (+ 1087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.701187 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.701190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.701201 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.701224 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.701238 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.701325 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.701458 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.701500 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:48:41.702523 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.697685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41653 (local address 127.17.188.66:60603)
0811 04:48:41.698477 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.698529 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.699735 (+ 1206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.700267 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.700274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.700358 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.700936 (+ 578us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.700937 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.700976 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.701042 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.701312 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.701320 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.701325 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.701499 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.701752 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":166,"threads_started":1}
I20260811 04:48:41.703675 23700 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41653
I20260811 04:48:41.703930 23700 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:41.704484 23700 heartbeater.cc:511] Master 127.17.188.126:41653 requested a full tablet report, sending...
I20260811 04:48:41.705716 23354 ts_manager.cc:194] Registered new tserver with Master: ae67ab8ed46646af9a1e74002c85dcf9 (127.17.188.66:38889)
W20260811 04:48:41.812412 23703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:41.812780 23703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:41.812826 23703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:41.817112 23703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:41.817175 23703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:41.817265 23703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:41.822064 23703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41653
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:41.823174 23703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:41.824568 23703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:41.834057 23710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:41.834049 23709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:41.834097 23703 server_base.cc:1034] running on GCE node
W20260811 04:48:41.834049 23712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:41.834734 23703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:41.835342 23703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:41.836527 23703 hybrid_clock.cc:648] HybridClock initialized: now 1786423721836508 us; error 38 us; skew 500 ppm
I20260811 04:48:41.838438 23703 webserver.cc:460] Webserver started at http://127.17.188.67:43421/ using document root <none> and password file <none>
I20260811 04:48:41.839017 23703 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:41.839118 23703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:41.839354 23703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:41.841672 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "4c77106922db47e28a97fb422515192f"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "741910d12bd5d32a3753fc9a0ba3d846"
server_key_iv: "fc6a7701ea01f11fd33f4787ca9d2caf"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.842267 23703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "4c77106922db47e28a97fb422515192f"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "741910d12bd5d32a3753fc9a0ba3d846"
server_key_iv: "fc6a7701ea01f11fd33f4787ca9d2caf"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.846053 23703 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.004s
I20260811 04:48:41.848511 23718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.849711 23703 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:41.849840 23703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "4c77106922db47e28a97fb422515192f"
format_stamp: "Formatted at 2026-08-11 04:48:41 on dist-test-slave-njxd"
server_key: "741910d12bd5d32a3753fc9a0ba3d846"
server_key_iv: "fc6a7701ea01f11fd33f4787ca9d2caf"
server_key_version: "encryptionkey@0"
I20260811 04:48:41.849946 23703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:41.854331 23703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:41.854987 23703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:41.855167 23703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:41.855711 23703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:41.856585 23703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:41.856660 23703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.856729 23703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:41.856781 23703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:41.865345 23703 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:39675
I20260811 04:48:41.865375 23839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:39675 every 8 connection(s)
I20260811 04:48:41.866279 23703 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:41.871996 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.868006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:35197 (local address 127.17.188.126:41653)
0811 04:48:41.868147 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.868150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.869150 (+ 1000us) server_negotiation.cc:407] Connection header received
0811 04:48:41.870432 (+ 1282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.870434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.870471 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.870544 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.871668 (+ 1124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.871670 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.871673 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.871681 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.871695 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.871701 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.871766 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.871857 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.871892 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 04:48:41.872821 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.868359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41653 (local address 127.17.188.67:35197)
0811 04:48:41.868994 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.869039 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.870247 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.870716 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.870722 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.870803 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.871417 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.871418 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.871458 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.871534 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.871753 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.871757 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.871761 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.871876 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.872085 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":107,"threads_started":1}
I20260811 04:48:41.873945 23840 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41653
I20260811 04:48:41.874159 23840 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:41.874537 23840 heartbeater.cc:511] Master 127.17.188.126:41653 requested a full tablet report, sending...
I20260811 04:48:41.875349 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23703
I20260811 04:48:41.875502 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:41.875644 23354 ts_manager.cc:194] Registered new tserver with Master: 4c77106922db47e28a97fb422515192f (127.17.188.67:39675)
I20260811 04:48:41.875850 18161 external_mini_cluster.cc:1428] Setting key 5e333afb01fff9001d79d6b02189f26c
I20260811 04:48:41.877981 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:48:41.882030 23395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.880272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44536 (local address 127.17.188.126:41653)
0811 04:48:41.880387 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.880392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.880636 (+ 244us) server_negotiation.cc:407] Connection header received
0811 04:48:41.880718 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.880720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.880748 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.880827 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.881554 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.881558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.881560 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.881613 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.881636 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.881646 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.881752 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.881835 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.881874 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:48:41.884557 23354 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44536:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:41.887651 23354 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:41.899044 23851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.895942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:41997 (local address 127.0.0.1:45416)
0811 04:48:41.896469 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.896521 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.896619 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.897607 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.897614 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.897694 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.898235 (+ 541us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.898237 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.898258 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.898323 (+ 65us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.898717 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.898727 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.898733 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.898844 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.898912 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":126,"threads_started":1}
I20260811 04:48:41.899058 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.896821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45416 (local address 127.17.188.65:41997)
0811 04:48:41.897175 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.897188 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.897211 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:48:41.897257 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.897261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.897425 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.897612 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.898446 (+ 834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.898453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.898465 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.898479 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.898524 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.898571 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.898748 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.898857 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.898929 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":137,"threads_started":1}
I20260811 04:48:41.899395 23852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.895859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.17.188.66:38889)
0811 04:48:41.896207 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.896221 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.896620 (+ 399us) server_negotiation.cc:407] Connection header received
0811 04:48:41.897231 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.897239 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.897425 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.897589 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.898740 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.898748 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.898761 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.898775 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.898814 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.898841 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.898955 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.899175 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.899245 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":120,"threads_started":1}
I20260811 04:48:41.899746 23853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.895670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38889 (local address 127.0.0.1:48776)
0811 04:48:41.896469 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.896521 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.897062 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.897956 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.897959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.897974 (+ 15us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.898411 (+ 437us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.898415 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.898429 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.898464 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.899038 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.899041 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.899044 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.899591 (+ 547us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.899631 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":88,"threads_started":1}
I20260811 04:48:41.900349 23854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.896389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39675 (local address 127.0.0.1:48302)
0811 04:48:41.897225 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.897237 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.897331 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.898440 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.898443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.898455 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.899741 (+ 1286us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.899744 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.899759 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.899785 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.900106 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.900110 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.900113 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.900195 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.900228 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":86,"threads_started":1}
I20260811 04:48:41.900419 23855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.896772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.17.188.67:39675)
0811 04:48:41.897123 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.897134 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.897324 (+ 190us) server_negotiation.cc:407] Connection header received
0811 04:48:41.897414 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.897425 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.897636 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.897763 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.899916 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.899921 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.899932 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.899943 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.899983 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.900012 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.900118 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.900207 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.900270 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":120,"threads_started":1}
I20260811 04:48:41.902531 23629 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed (DEFAULT_TABLE table=test-table [id=005779eff68b4dc3bcb7728c8b4545cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:41.902531 23485 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed (DEFAULT_TABLE table=test-table [id=005779eff68b4dc3bcb7728c8b4545cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:41.903802 23629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c6b952b40abb94b54626619b1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:41.903802 23485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c6b952b40abb94b54626619b1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:41.903975 23769 tablet_service.cc:1467] Processing CreateTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed (DEFAULT_TABLE table=test-table [id=005779eff68b4dc3bcb7728c8b4545cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:41.904862 23769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c2d9c6b952b40abb94b54626619b1ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:41.911629 23857 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Bootstrap starting.
I20260811 04:48:41.911728 23858 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Bootstrap starting.
I20260811 04:48:41.911888 23859 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: Bootstrap starting.
I20260811 04:48:41.913717 23857 tablet_bootstrap.cc:654] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:41.913866 23859 tablet_bootstrap.cc:654] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:41.913885 23858 tablet_bootstrap.cc:654] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:41.914489 23857 log.cc:824] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:41.914675 23858 log.cc:824] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:41.914675 23859 log.cc:824] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:41.916684 23858 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: No bootstrap required, opened a new log
I20260811 04:48:41.916683 23857 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: No bootstrap required, opened a new log
I20260811 04:48:41.916867 23859 tablet_bootstrap.cc:492] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: No bootstrap required, opened a new log
I20260811 04:48:41.916893 23858 ts_tablet_manager.cc:1397] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:48:41.916893 23857 ts_tablet_manager.cc:1397] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 04:48:41.917133 23859 ts_tablet_manager.cc:1397] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:48:41.920346 23859 raft_consensus.cc:348] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.920595 23859 raft_consensus.cc:374] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:41.920648 23859 raft_consensus.cc:729] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5571a1121d5440b69a9cf2ead30f4710, State: Initialized, Role: FOLLOWER
I20260811 04:48:41.921080 23859 consensus_queue.cc:260] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.921388 23858 raft_consensus.cc:348] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.921388 23857 raft_consensus.cc:348] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.921659 23858 raft_consensus.cc:374] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:41.921674 23857 raft_consensus.cc:374] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:41.921725 23858 raft_consensus.cc:729] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae67ab8ed46646af9a1e74002c85dcf9, State: Initialized, Role: FOLLOWER
I20260811 04:48:41.921731 23857 raft_consensus.cc:729] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c77106922db47e28a97fb422515192f, State: Initialized, Role: FOLLOWER
I20260811 04:48:41.921823 23558 heartbeater.cc:503] Master 127.17.188.126:41653 was elected leader, sending a full tablet report...
I20260811 04:48:41.922144 23859 ts_tablet_manager.cc:1428] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:48:41.922170 23857 consensus_queue.cc:260] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.922170 23858 consensus_queue.cc:260] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.923092 23858 ts_tablet_manager.cc:1428] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:48:41.923139 23857 ts_tablet_manager.cc:1428] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Time spent starting tablet: real 0.006s user 0.007s sys 0.001s
I20260811 04:48:41.923421 23700 heartbeater.cc:503] Master 127.17.188.126:41653 was elected leader, sending a full tablet report...
I20260811 04:48:41.924474 23866 raft_consensus.cc:482] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:41.924644 23866 raft_consensus.cc:504] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.925808 23840 heartbeater.cc:503] Master 127.17.188.126:41653 was elected leader, sending a full tablet report...
I20260811 04:48:41.926110 23866 leader_election.cc:288] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae67ab8ed46646af9a1e74002c85dcf9 (127.17.188.66:38889), 5571a1121d5440b69a9cf2ead30f4710 (127.17.188.65:41997)
I20260811 04:48:41.928390 23842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.926082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38889 (local address 127.17.188.67:51515)
0811 04:48:41.926461 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.926478 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.926577 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.927139 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.927143 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.927164 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.927773 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.927777 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.927792 (+ 15us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.927819 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.928129 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.928133 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.928136 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.928216 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.928272 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296}
I20260811 04:48:41.928725 23852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.926364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:51515 (local address 127.17.188.66:38889)
0811 04:48:41.926477 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.926481 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.926529 (+ 48us) server_negotiation.cc:407] Connection header received
0811 04:48:41.926903 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.926908 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.926947 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.927026 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.927960 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.927963 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.927965 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.927974 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.927989 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.927996 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.928092 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.928565 (+ 473us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.928609 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:48:41.929230 23651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c6b952b40abb94b54626619b1ed" candidate_uuid: "4c77106922db47e28a97fb422515192f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" is_pre_election: true
I20260811 04:48:41.929468 23651 raft_consensus.cc:2454] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c77106922db47e28a97fb422515192f in term 0.
I20260811 04:48:41.929872 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.926713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:50821 (local address 127.17.188.65:41997)
0811 04:48:41.926859 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.926865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.927836 (+ 971us) server_negotiation.cc:407] Connection header received
0811 04:48:41.927920 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.927923 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.927954 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.928035 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.928823 (+ 788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.928826 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.928830 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.928842 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.928862 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.928872 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.928952 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.929709 (+ 757us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.929757 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 04:48:41.929903 23867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.926084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:41997 (local address 127.17.188.67:50821)
0811 04:48:41.927722 (+ 1638us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.927738 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:41.927830 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:41.928076 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:41.928078 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:41.928092 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:41.928650 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:48:41.928652 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:41.928661 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:48:41.928685 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:41.928938 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:41.928941 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:41.928945 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:48:41.929704 (+ 759us) client_negotiation.cc:240] Negotiation successful
0811 04:48:41.929753 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1549,"mutex_wait_us":572,"thread_start_us":104,"threads_started":1}
I20260811 04:48:41.929971 23722 leader_election.cc:302] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c77106922db47e28a97fb422515192f, ae67ab8ed46646af9a1e74002c85dcf9; no voters:
I20260811 04:48:41.930248 23864 raft_consensus.cc:2781] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:41.930320 23864 raft_consensus.cc:482] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:41.930349 23864 raft_consensus.cc:3037] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:41.930605 23508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c6b952b40abb94b54626619b1ed" candidate_uuid: "4c77106922db47e28a97fb422515192f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5571a1121d5440b69a9cf2ead30f4710" is_pre_election: true
I20260811 04:48:41.930835 23508 raft_consensus.cc:2454] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c77106922db47e28a97fb422515192f in term 0.
I20260811 04:48:41.931587 23864 raft_consensus.cc:504] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.931921 23864 leader_election.cc:288] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [CANDIDATE]: Term 1 election: Requested vote from peers ae67ab8ed46646af9a1e74002c85dcf9 (127.17.188.66:38889), 5571a1121d5440b69a9cf2ead30f4710 (127.17.188.65:41997)
I20260811 04:48:41.932215 23651 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c6b952b40abb94b54626619b1ed" candidate_uuid: "4c77106922db47e28a97fb422515192f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae67ab8ed46646af9a1e74002c85dcf9"
I20260811 04:48:41.932238 23508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c2d9c6b952b40abb94b54626619b1ed" candidate_uuid: "4c77106922db47e28a97fb422515192f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5571a1121d5440b69a9cf2ead30f4710"
I20260811 04:48:41.932335 23651 raft_consensus.cc:3037] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:41.932356 23508 raft_consensus.cc:3037] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:41.933612 23508 raft_consensus.cc:2454] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c77106922db47e28a97fb422515192f in term 1.
I20260811 04:48:41.933626 23651 raft_consensus.cc:2454] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c77106922db47e28a97fb422515192f in term 1.
I20260811 04:48:41.933911 23719 leader_election.cc:302] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c77106922db47e28a97fb422515192f, 5571a1121d5440b69a9cf2ead30f4710; no voters:
I20260811 04:48:41.934075 23864 raft_consensus.cc:2781] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:41.934171 23864 raft_consensus.cc:686] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 1 LEADER]: Becoming Leader. State: Replica: 4c77106922db47e28a97fb422515192f, State: Running, Role: LEADER
I20260811 04:48:41.934424 23864 consensus_queue.cc:237] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } }
I20260811 04:48:41.936795 23353 catalog_manager.cc:5495] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c77106922db47e28a97fb422515192f (127.17.188.67). New cstate: current_term: 1 leader_uuid: "4c77106922db47e28a97fb422515192f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c77106922db47e28a97fb422515192f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39675 } health_report { overall_health: HEALTHY } } }
W20260811 04:48:41.945811 23701 tablet.cc:2369] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:41.950214 23855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.948770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48314 (local address 127.17.188.67:39675)
0811 04:48:41.948890 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:41.948893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:41.948907 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:41.949032 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:41.949035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:41.949091 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:41.949170 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:41.949889 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:41.949892 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:41.949894 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:41.949905 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:41.949923 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:41.949931 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:41.950002 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:41.950080 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 04:48:41.950119 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:48:41.956117 23651 raft_consensus.cc:1261] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 1 FOLLOWER]: Refusing update from remote peer 4c77106922db47e28a97fb422515192f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:41.956152 23508 raft_consensus.cc:1261] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 1 FOLLOWER]: Refusing update from remote peer 4c77106922db47e28a97fb422515192f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:41.956832 23864 consensus_queue.cc:1035] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae67ab8ed46646af9a1e74002c85dcf9" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:41.957044 23866 consensus_queue.cc:1035] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5571a1121d5440b69a9cf2ead30f4710" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 41997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:41.965301 23871 mvcc.cc:205] Tried to move back new op lower bound from 7317191565124825088 to 7317191565045497856. Current Snapshot: MvccSnapshot[applied={T|T < 7317191565124825088}]
I20260811 04:48:41.977213 23353 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:41.977423 23353 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44536:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:41.980109 23353 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab4251741b934d529679eed96e9f1fc7: Sending DeleteTablet for 3 replicas of tablet 7c2d9c6b952b40abb94b54626619b1ed
I20260811 04:48:41.980952 23485 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='slave'} at 127.0.0.1:45416
I20260811 04:48:41.980952 23769 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='slave'} at 127.0.0.1:48302
I20260811 04:48:41.981477 23882 tablet_replica.cc:330] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710: stopping tablet replica
I20260811 04:48:41.981678 23629 tablet_service.cc:1514] Processing DeleteTablet for tablet 7c2d9c6b952b40abb94b54626619b1ed with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:41 UTC) from {username='slave'} at 127.0.0.1:48776
I20260811 04:48:41.982054 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23418
I20260811 04:48:41.982321 23882 raft_consensus.cc:2229] T 7c2d9c6b952b40abb94b54626619b1ed P 5571a1121d5440b69a9cf2ead30f4710 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:41.983582 23883 tablet_replica.cc:330] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: stopping tablet replica
I20260811 04:48:41.984011 23883 raft_consensus.cc:2229] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:41.984512 23883 raft_consensus.cc:2258] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:41.986284 23883 ts_tablet_manager.cc:1905] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:41.986575 23884 tablet_replica.cc:330] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: stopping tablet replica
I20260811 04:48:41.986877 23884 raft_consensus.cc:2229] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:41.987215 23884 raft_consensus.cc:2258] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:41.988678 23884 ts_tablet_manager.cc:1905] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:41.990157 23883 ts_tablet_manager.cc:1918] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:41.990309 23883 log.cc:1196] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/7c2d9c6b952b40abb94b54626619b1ed
I20260811 04:48:41.990742 23883 ts_tablet_manager.cc:1939] T 7c2d9c6b952b40abb94b54626619b1ed P 4c77106922db47e28a97fb422515192f: Deleting consensus metadata
I20260811 04:48:41.991555 23884 ts_tablet_manager.cc:1918] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:41.991657 23884 log.cc:1196] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/7c2d9c6b952b40abb94b54626619b1ed
I20260811 04:48:41.991958 23884 ts_tablet_manager.cc:1939] T 7c2d9c6b952b40abb94b54626619b1ed P ae67ab8ed46646af9a1e74002c85dcf9: Deleting consensus metadata
I20260811 04:48:41.992165 23338 catalog_manager.cc:4841] TS 4c77106922db47e28a97fb422515192f (127.17.188.67:39675): tablet 7c2d9c6b952b40abb94b54626619b1ed (table test-table [id=005779eff68b4dc3bcb7728c8b4545cd]) successfully deleted
W20260811 04:48:41.992260 23334 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:41997 (error 108)
I20260811 04:48:41.993073 23338 catalog_manager.cc:4841] TS ae67ab8ed46646af9a1e74002c85dcf9 (127.17.188.66:38889): tablet 7c2d9c6b952b40abb94b54626619b1ed (table test-table [id=005779eff68b4dc3bcb7728c8b4545cd]) successfully deleted
I20260811 04:48:41.993400 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23561
I20260811 04:48:41.993446 23854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:41.992994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:41997 (local address 127.0.0.1:45426)
0811 04:48:41.993292 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:41.993365 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:41997: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216}
W20260811 04:48:41.994959 23334 catalog_manager.cc:4584] TS 5571a1121d5440b69a9cf2ead30f4710 (127.17.188.65:41997): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7c2d9c6b952b40abb94b54626619b1ed: Network error: Client connection negotiation failed: client connection to 127.17.188.65:41997: connect: Connection refused (error 111)
I20260811 04:48:41.999991 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23703
I20260811 04:48:42.009546 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23316
2026-08-11T04:48:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (907 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 04:48:42.031992 18161 mini_oidc.cc:152] Starting JWKS server
I20260811 04:48:42.033692 18161 webserver.cc:460] Webserver started at https://127.0.0.1:43169/ using document root <none> and password file <none>
I20260811 04:48:42.033890 18161 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 04:48:42.034169 18161 webserver.cc:460] Webserver started at http://127.0.0.1:39267/ using document root <none> and password file <none>
2026-08-11T04:48:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:42Z Disabled control of system clock
I20260811 04:48:42.044286 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39227
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:41857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:39227
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43169/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/testchainca.cert with env {}
W20260811 04:48:42.152777 23891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:42.152990 23891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:42.153024 23891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:42.156715 23891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:42.156762 23891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:42.156777 23891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:42.156793 23891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:42.156807 23891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 04:48:42.156822 23891 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 04:48:42.156836 23891 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43169/jwks.json
I20260811 04:48:42.161831 23891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:39227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43169/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:42.162689 23891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:42.163535 23891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:42.171777 23898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.171829 23891 server_base.cc:1034] running on GCE node
W20260811 04:48:42.171808 23900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:42.171797 23897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.172607 23891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:42.173694 23891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:42.174887 23891 hybrid_clock.cc:648] HybridClock initialized: now 1786423722174879 us; error 30 us; skew 500 ppm
I20260811 04:48:42.176728 23891 webserver.cc:460] Webserver started at http://127.17.188.126:41239/ using document root <none> and password file <none>
I20260811 04:48:42.177312 23891 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:42.177407 23891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:42.177706 23891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:42.179662 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "5481b2567b1c4d4fb64dab44aeb24f21"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a775c595bec98b60aaaf8e174878f8cc"
server_key_iv: "93beeede98d3b6c464016a08711c1cad"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.180208 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "5481b2567b1c4d4fb64dab44aeb24f21"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a775c595bec98b60aaaf8e174878f8cc"
server_key_iv: "93beeede98d3b6c464016a08711c1cad"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.183720 23891 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:48:42.185988 23906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:42.187141 23891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:42.187294 23891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "5481b2567b1c4d4fb64dab44aeb24f21"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a775c595bec98b60aaaf8e174878f8cc"
server_key_iv: "93beeede98d3b6c464016a08711c1cad"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.187414 23891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:42.202350 23891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:42.203061 23891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:42.203267 23891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:42.210462 23891 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:39227
I20260811 04:48:42.210495 23963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:39227 every 8 connection(s)
I20260811 04:48:42.211407 23891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:42.214612 23964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:42.219918 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 23891
I20260811 04:48:42.220042 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:42.220247 23964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21: Bootstrap starting.
I20260811 04:48:42.220364 18161 external_mini_cluster.cc:1428] Setting key 8d5fefbf94e3a14a8085a43d6252d2e6
I20260811 04:48:42.222879 23964 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:42.223629 23964 log.cc:824] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:42.225426 23964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21: No bootstrap required, opened a new log
I20260811 04:48:42.228919 23964 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } }
I20260811 04:48:42.229163 23964 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:42.229242 23964 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5481b2567b1c4d4fb64dab44aeb24f21, State: Initialized, Role: FOLLOWER
I20260811 04:48:42.229707 23967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.221729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59444 (local address 127.17.188.126:39227)
0811 04:48:42.222381 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.222395 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.222429 (+ 34us) server_negotiation.cc:407] Connection header received
0811 04:48:42.223141 (+ 712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.223161 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.223549 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.223950 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:42.224379 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.225320 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.226339 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.226823 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.227001 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.227858 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:42.227863 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:42.227875 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:42.228248 (+ 373us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:42.228302 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:42.228321 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:42.228429 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:42.228568 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 04:48:42.228828 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":144,"threads_started":1}
I20260811 04:48:42.229776 23964 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } }
I20260811 04:48:42.229947 23964 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:42.230007 23964 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:42.230105 23964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:42.231094 23964 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } }
I20260811 04:48:42.231444 23964 leader_election.cc:302] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5481b2567b1c4d4fb64dab44aeb24f21; no voters:
I20260811 04:48:42.231775 23964 leader_election.cc:288] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:42.231879 23969 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:42.232100 23969 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [term 1 LEADER]: Becoming Leader. State: Replica: 5481b2567b1c4d4fb64dab44aeb24f21, State: Running, Role: LEADER
I20260811 04:48:42.232398 23969 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } }
I20260811 04:48:42.232692 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:48:42.233096 23964 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:42.234088 23970 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } } }
I20260811 04:48:42.234103 23971 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5481b2567b1c4d4fb64dab44aeb24f21. Latest consensus state: current_term: 1 leader_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5481b2567b1c4d4fb64dab44aeb24f21" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39227 } } }
I20260811 04:48:42.234249 23971 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.234251 23970 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.234709 23978 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:42.237712 23978 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:42.243068 23978 catalog_manager.cc:1347] Generated new cluster ID: 64b9e68f7c774cc7bbd5ae412540076e
I20260811 04:48:42.243156 23978 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:42.250622 23978 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:42.251816 23978 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:42.263175 23978 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5481b2567b1c4d4fb64dab44aeb24f21: Generated new TSK 0
I20260811 04:48:42.264034 23978 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 04:48:42.302127 23996 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 04:48:42.302244 23996 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 04:48:42.302760 23967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.278190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59456 (local address 127.17.188.126:39227)
0811 04:48:42.278337 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.278342 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.278566 (+ 224us) server_negotiation.cc:407] Connection header received
0811 04:48:42.278802 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.278804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.278852 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.278942 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0811 04:48:42.279242 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.279993 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.281253 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.281490 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.281675 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.281997 (+ 322us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 04:48:42.302305 (+ 20308us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 04:48:42.302645 (+ 340us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59456: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 04:48:42.302863 23967 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59456: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 04:48:42.304200 23995 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:42.278102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:39227 (local address 127.0.0.1:59456)
0811 04:48:42.278472 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:42.278487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:42.278635 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:42.278984 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:42.278988 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:42.278996 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 04:48:42.279136 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.279142 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.280119 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.280123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.281120 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.281133 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.281635 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.281639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.281735 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.281792 (+ 57us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 04:48:42.302580 (+ 20788us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 04:48:42.302836 (+ 256us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.188.126:39227: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":126,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.17.188.126:39227: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43169/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 04:48:42.305013 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 23891
2026-08-11T04:48:42Z chronyd exiting
I20260811 04:48:42.345970 18161 test_util.cc:175] -----------------------------------------------
I20260811 04:48:42.346057 18161 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786423695299078-18161-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (315 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 04:48:42.347105 18161 mini_oidc.cc:152] Starting JWKS server
I20260811 04:48:42.347958 18161 webserver.cc:460] Webserver started at https://127.0.0.1:33471/ using document root <none> and password file <none>
I20260811 04:48:42.348061 18161 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 04:48:42.348361 18161 webserver.cc:460] Webserver started at http://127.0.0.1:44567/ using document root <none> and password file <none>
2026-08-11T04:48:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:42Z Disabled control of system clock
I20260811 04:48:42.358268 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35317
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:45159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:35317
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33471/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/testchainca.cert with env {}
W20260811 04:48:42.468323 24003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:42.468598 24003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:42.468640 24003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:42.472657 24003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:42.472714 24003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:42.472730 24003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:42.472746 24003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:42.472761 24003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 04:48:42.472819 24003 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 04:48:42.472837 24003 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33471/jwks.json
I20260811 04:48:42.478199 24003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:45159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:35317
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33471/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:42.479249 24003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:42.480278 24003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:42.488632 24008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.488718 24003 server_base.cc:1034] running on GCE node
W20260811 04:48:42.488721 24011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:42.488653 24009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.489452 24003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:42.490607 24003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:42.491763 24003 hybrid_clock.cc:648] HybridClock initialized: now 1786423722491743 us; error 51 us; skew 500 ppm
I20260811 04:48:42.493474 24003 webserver.cc:460] Webserver started at http://127.17.188.126:40479/ using document root <none> and password file <none>
I20260811 04:48:42.494043 24003 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:42.494112 24003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:42.494351 24003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:42.496344 24003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "d885e1600b244980badf2b55650b381c"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a8648c8d38967c3b8a3f307e93e82f94"
server_key_iv: "eae511ebed05bec66eb05e4dab2e0579"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.496901 24003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "d885e1600b244980badf2b55650b381c"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a8648c8d38967c3b8a3f307e93e82f94"
server_key_iv: "eae511ebed05bec66eb05e4dab2e0579"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.500522 24003 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:48:42.502931 24018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:42.504058 24003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:42.504189 24003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "d885e1600b244980badf2b55650b381c"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "a8648c8d38967c3b8a3f307e93e82f94"
server_key_iv: "eae511ebed05bec66eb05e4dab2e0579"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.504288 24003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:42.515174 24003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:42.515777 24003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:42.515964 24003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:42.522753 24003 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:35317
I20260811 04:48:42.522773 24073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:35317 every 8 connection(s)
I20260811 04:48:42.523686 24003 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:42.526803 24074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:42.532146 24074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c: Bootstrap starting.
I20260811 04:48:42.533862 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24003
I20260811 04:48:42.533981 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:42.534281 18161 external_mini_cluster.cc:1428] Setting key 824ea6a712bc5611a0151a54b9c205be
I20260811 04:48:42.534883 24074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:42.535840 24074 log.cc:824] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:42.537922 24074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c: No bootstrap required, opened a new log
I20260811 04:48:42.541343 24074 raft_consensus.cc:348] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } }
I20260811 04:48:42.541627 24074 raft_consensus.cc:374] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:42.541735 24074 raft_consensus.cc:729] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d885e1600b244980badf2b55650b381c, State: Initialized, Role: FOLLOWER
I20260811 04:48:42.542217 24074 consensus_queue.cc:260] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } }
I20260811 04:48:42.542371 24074 raft_consensus.cc:388] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:42.542441 24074 raft_consensus.cc:482] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:42.542550 24074 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:42.543479 24074 raft_consensus.cc:504] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } }
I20260811 04:48:42.543504 24077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.535400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48632 (local address 127.17.188.126:35317)
0811 04:48:42.536063 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.536082 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.536118 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:48:42.536950 (+ 832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.536971 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.537303 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.537690 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:42.538144 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.539078 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.539931 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.540376 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.540548 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.541504 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:42.541511 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:42.541526 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:42.542089 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:42.542148 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:42.542171 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:42.542295 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:42.542499 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 04:48:42.542794 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":126,"threads_started":1}
I20260811 04:48:42.543895 24074 leader_election.cc:302] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d885e1600b244980badf2b55650b381c; no voters:
I20260811 04:48:42.544220 24074 leader_election.cc:288] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:42.544343 24079 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:42.544566 24079 raft_consensus.cc:686] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [term 1 LEADER]: Becoming Leader. State: Replica: d885e1600b244980badf2b55650b381c, State: Running, Role: LEADER
I20260811 04:48:42.544909 24079 consensus_queue.cc:237] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } }
I20260811 04:48:42.545432 24074 sys_catalog.cc:564] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:42.546464 24081 sys_catalog.cc:455] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d885e1600b244980badf2b55650b381c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } } }
I20260811 04:48:42.546638 24081 sys_catalog.cc:458] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.546738 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:48:42.547137 24088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:42.547803 24080 sys_catalog.cc:455] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d885e1600b244980badf2b55650b381c. Latest consensus state: current_term: 1 leader_uuid: "d885e1600b244980badf2b55650b381c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d885e1600b244980badf2b55650b381c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35317 } } }
I20260811 04:48:42.547906 24080 sys_catalog.cc:458] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.550840 24088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:42.556239 24088 catalog_manager.cc:1347] Generated new cluster ID: 5b0c3ac024d44f83ba756c68ffe60434
I20260811 04:48:42.556303 24088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:42.580868 24088 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:42.581923 24088 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:42.587433 24088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d885e1600b244980badf2b55650b381c: Generated new TSK 0
I20260811 04:48:42.588102 24088 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 04:48:42.611101 24104 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 04:48:42.611187 24104 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 04:48:42.611820 24077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.596160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48638 (local address 127.17.188.126:35317)
0811 04:48:42.596287 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.596291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.596435 (+ 144us) server_negotiation.cc:407] Connection header received
0811 04:48:42.596588 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.596591 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.596636 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.596724 (+ 88us) server_negotiation.cc:226] Negotiated authn=JWT
0811 04:48:42.597007 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.597516 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.598759 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.598995 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.599071 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.599418 (+ 347us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 04:48:42.611494 (+ 12076us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 04:48:42.611704 (+ 210us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48638: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 04:48:42.611903 24077 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48638: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 04:48:42.612049 24103 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:42.595993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35317 (local address 127.0.0.1:48638)
0811 04:48:42.596340 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:42.596355 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:42.596473 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:42.596758 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:42.596761 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:42.596769 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 04:48:42.596892 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.596899 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.597637 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.597641 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.598601 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.598641 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.599111 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.599115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.599217 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.599250 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 04:48:42.611687 (+ 12437us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 04:48:42.611867 (+ 180us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.188.126:35317: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33471/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":112,"threads_started":1}
I20260811 04:48:42.612746 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24003
2026-08-11T04:48:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (306 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 04:48:42.653924 18161 mini_oidc.cc:152] Starting JWKS server
I20260811 04:48:42.654834 18161 webserver.cc:460] Webserver started at https://127.0.0.1:43079/ using document root <none> and password file <none>
I20260811 04:48:42.654963 18161 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 04:48:42.655232 18161 webserver.cc:460] Webserver started at http://127.0.0.1:34831/ using document root <none> and password file <none>
2026-08-11T04:48:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:42Z Disabled control of system clock
I20260811 04:48:42.665169 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37649
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:37241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:37649
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43079/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 04:48:42.774329 24110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:42.774641 24110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:42.774721 24110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:42.778612 24110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:42.778659 24110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:42.778674 24110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:42.778712 24110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:42.778741 24110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 04:48:42.778766 24110 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 04:48:42.778793 24110 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43079/jwks.json
I20260811 04:48:42.783268 24110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:37649
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43079/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:42.784226 24110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:42.785508 24110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:42.793381 24116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.793478 24110 server_base.cc:1034] running on GCE node
W20260811 04:48:42.793395 24115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:42.793381 24119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:42.794239 24110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:42.795249 24110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:42.796409 24110 hybrid_clock.cc:648] HybridClock initialized: now 1786423722796383 us; error 40 us; skew 500 ppm
I20260811 04:48:42.798202 24110 webserver.cc:460] Webserver started at http://127.17.188.126:35079/ using document root <none> and password file <none>
I20260811 04:48:42.798780 24110 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:42.798841 24110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:42.799088 24110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:42.801326 24110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "813d745f77544bd59664b81fecc74e27"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "6fd347b56cc9eef055458bbcccf1a93c"
server_key_iv: "abcfcd81e7549aac02b666541b31539b"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.801936 24110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "813d745f77544bd59664b81fecc74e27"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "6fd347b56cc9eef055458bbcccf1a93c"
server_key_iv: "abcfcd81e7549aac02b666541b31539b"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.805716 24110 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 04:48:42.808190 24125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:42.809455 24110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:42.809594 24110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "813d745f77544bd59664b81fecc74e27"
format_stamp: "Formatted at 2026-08-11 04:48:42 on dist-test-slave-njxd"
server_key: "6fd347b56cc9eef055458bbcccf1a93c"
server_key_iv: "abcfcd81e7549aac02b666541b31539b"
server_key_version: "encryptionkey@0"
I20260811 04:48:42.809737 24110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:42.841707 24110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:42.842502 24110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:42.842730 24110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:42.850099 24110 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:37649
I20260811 04:48:42.850127 24182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:37649 every 8 connection(s)
I20260811 04:48:42.851052 24110 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:42.854426 24183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:42.860529 24183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27: Bootstrap starting.
I20260811 04:48:42.861212 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24110
I20260811 04:48:42.861320 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:42.861706 18161 external_mini_cluster.cc:1428] Setting key 45f96d9f46e3c4da7f6fa196e6db8316
I20260811 04:48:42.863615 24183 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:42.864404 24183 log.cc:824] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:42.866597 24183 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27: No bootstrap required, opened a new log
I20260811 04:48:42.871260 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.863022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52624 (local address 127.17.188.126:37649)
0811 04:48:42.863698 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.863736 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.863782 (+ 46us) server_negotiation.cc:407] Connection header received
0811 04:48:42.864403 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.864419 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.864922 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.865283 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:42.865699 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.866684 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.868026 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.868474 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.868597 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.869486 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:42.869491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:42.869503 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:42.869940 (+ 437us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:42.869992 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:42.870012 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:42.870086 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:42.870280 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 04:48:42.870548 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":145,"threads_started":1}
I20260811 04:48:42.871258 24183 raft_consensus.cc:348] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } }
I20260811 04:48:42.871642 24183 raft_consensus.cc:374] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:42.871737 24183 raft_consensus.cc:729] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813d745f77544bd59664b81fecc74e27, State: Initialized, Role: FOLLOWER
I20260811 04:48:42.872270 24183 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } }
I20260811 04:48:42.872430 24183 raft_consensus.cc:388] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:42.872494 24183 raft_consensus.cc:482] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:42.872586 24183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:42.873715 24183 raft_consensus.cc:504] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } }
I20260811 04:48:42.874096 24183 leader_election.cc:302] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 813d745f77544bd59664b81fecc74e27; no voters:
I20260811 04:48:42.874230 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:48:42.874495 24183 leader_election.cc:288] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:42.874624 24188 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:42.874831 24188 raft_consensus.cc:686] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [term 1 LEADER]: Becoming Leader. State: Replica: 813d745f77544bd59664b81fecc74e27, State: Running, Role: LEADER
I20260811 04:48:42.875133 24188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } }
I20260811 04:48:42.875943 24183 sys_catalog.cc:564] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:42.876785 24189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "813d745f77544bd59664b81fecc74e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } } }
I20260811 04:48:42.876909 24189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.877221 24190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 813d745f77544bd59664b81fecc74e27. Latest consensus state: current_term: 1 leader_uuid: "813d745f77544bd59664b81fecc74e27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813d745f77544bd59664b81fecc74e27" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 37649 } } }
I20260811 04:48:42.877313 24190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:42.877556 24197 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:42.880388 24197 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:42.885401 24197 catalog_manager.cc:1347] Generated new cluster ID: 06ba634a8a6c4664b5c0cf95109a647a
I20260811 04:48:42.885460 24197 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:42.893682 24197 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:42.894948 24197 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:42.902042 24197 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 813d745f77544bd59664b81fecc74e27: Generated new TSK 0
I20260811 04:48:42.902823 24197 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:48:42.920462 24186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:42.915685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52626 (local address 127.17.188.126:37649)
0811 04:48:42.915818 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:42.915824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:42.916002 (+ 178us) server_negotiation.cc:407] Connection header received
0811 04:48:42.916199 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:42.916202 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:42.916250 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:42.916365 (+ 115us) server_negotiation.cc:226] Negotiated authn=JWT
0811 04:48:42.916654 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.917188 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.918111 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.918339 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.918463 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.918771 (+ 308us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 04:48:42.920110 (+ 1339us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43079/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 04:48:42.920333 (+ 223us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52626: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43079/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 04:48:42.920526 24186 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52626: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43079/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 04:48:42.922519 24215 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:42.915616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:37649 (local address 127.0.0.1:52626)
0811 04:48:42.915910 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:42.915922 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:42.916050 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:42.916366 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:42.916369 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:42.916378 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 04:48:42.916492 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.916505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.917320 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.917325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.917981 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:42.917989 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:42.918476 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:42.918480 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:42.918576 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:42.918598 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 04:48:42.920279 (+ 1681us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43079/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 04:48:42.922342 (+ 2063us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.188.126:37649: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43079/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":211,"mutex_wait_us":1872,"thread_start_us":107,"threads_started":1}
I20260811 04:48:42.922847 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24110
E20260811 04:48:42.934880 24216 webserver.cc:533] Webserver: sslize failed:
E20260811 04:48:42.934971 24216 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T04:48:42Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (310 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T04:48:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:42Z Disabled control of system clock
I20260811 04:48:42.973894 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38181
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:44389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38181
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/testchainca.cert with env {}
W20260811 04:48:43.086696 24220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:43.086966 24220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:43.087041 24220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:43.091280 24220 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:43.091337 24220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:43.091352 24220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:43.091398 24220 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:43.091428 24220 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 04:48:43.091477 24220 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 04:48:43.091524 24220 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 04:48:43.096871 24220 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38181
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24220
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:43.098076 24220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:43.099179 24220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:43.107720 24228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:43.107738 24225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:43.107740 24226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:43.107987 24220 server_base.cc:1034] running on GCE node
I20260811 04:48:43.108665 24220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:43.109850 24220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:43.111009 24220 hybrid_clock.cc:648] HybridClock initialized: now 1786423723110982 us; error 39 us; skew 500 ppm
I20260811 04:48:43.112804 24220 webserver.cc:460] Webserver started at http://127.17.188.126:45939/ using document root <none> and password file <none>
I20260811 04:48:43.113386 24220 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:43.113448 24220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:43.113763 24220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:43.115854 24220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "a1cbb7fd5f584e5d88e450eebd972e1f"
format_stamp: "Formatted at 2026-08-11 04:48:43 on dist-test-slave-njxd"
server_key: "298fd0207096668a19a2a7aff5afaf42"
server_key_iv: "2f63d7f9104056d80c6b5e38facd6ec7"
server_key_version: "encryptionkey@0"
I20260811 04:48:43.116448 24220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "a1cbb7fd5f584e5d88e450eebd972e1f"
format_stamp: "Formatted at 2026-08-11 04:48:43 on dist-test-slave-njxd"
server_key: "298fd0207096668a19a2a7aff5afaf42"
server_key_iv: "2f63d7f9104056d80c6b5e38facd6ec7"
server_key_version: "encryptionkey@0"
I20260811 04:48:43.120193 24220 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:48:43.122587 24234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:43.123801 24220 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:43.123941 24220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "a1cbb7fd5f584e5d88e450eebd972e1f"
format_stamp: "Formatted at 2026-08-11 04:48:43 on dist-test-slave-njxd"
server_key: "298fd0207096668a19a2a7aff5afaf42"
server_key_iv: "2f63d7f9104056d80c6b5e38facd6ec7"
server_key_version: "encryptionkey@0"
I20260811 04:48:43.124063 24220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:43.138401 24220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:43.139024 24220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:43.139242 24220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:43.146297 24220 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:38181
I20260811 04:48:43.146325 24288 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:38181 every 8 connection(s)
I20260811 04:48:43.147220 24220 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:43.149672 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24220
I20260811 04:48:43.149823 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:43.150133 18161 external_mini_cluster.cc:1428] Setting key 03a5fa0a5abc4ca033888d85df858568
I20260811 04:48:43.150184 24291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:43.157337 24291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f: Bootstrap starting.
I20260811 04:48:43.159509 24295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:43.151437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55226 (local address 127.17.188.126:38181)
0811 04:48:43.152057 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:43.152074 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:43.152108 (+ 34us) server_negotiation.cc:407] Connection header received
0811 04:48:43.152857 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:43.152875 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:43.153286 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:43.153611 (+ 325us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:43.153963 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.154953 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.156223 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.156694 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.156814 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:43.157721 (+ 907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:43.157726 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:43.157757 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:48:43.158149 (+ 392us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:43.158201 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:48:43.158219 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:43.158295 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:43.158476 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 04:48:43.158767 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":149,"threads_started":1}
I20260811 04:48:43.159852 24291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:43.160722 24291 log.cc:824] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:43.162541 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:48:43.162861 24291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f: No bootstrap required, opened a new log
I20260811 04:48:43.166544 24291 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } }
I20260811 04:48:43.166790 24291 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:43.166874 24291 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1cbb7fd5f584e5d88e450eebd972e1f, State: Initialized, Role: FOLLOWER
I20260811 04:48:43.167292 24291 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } }
I20260811 04:48:43.167446 24291 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:43.167536 24291 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:43.167661 24291 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:43.168561 24291 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } }
I20260811 04:48:43.168915 24291 leader_election.cc:302] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1cbb7fd5f584e5d88e450eebd972e1f; no voters:
I20260811 04:48:43.169272 24291 leader_election.cc:288] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:43.169404 24297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:43.169669 24297 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [term 1 LEADER]: Becoming Leader. State: Replica: a1cbb7fd5f584e5d88e450eebd972e1f, State: Running, Role: LEADER
I20260811 04:48:43.169987 24297 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } }
I20260811 04:48:43.170578 24291 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:43.171608 24298 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } } }
I20260811 04:48:43.171741 24298 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:43.172111 24299 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1cbb7fd5f584e5d88e450eebd972e1f. Latest consensus state: current_term: 1 leader_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1cbb7fd5f584e5d88e450eebd972e1f" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38181 } } }
I20260811 04:48:43.172171 24306 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:43.172222 24299 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:43.174961 24306 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:43.180341 24306 catalog_manager.cc:1347] Generated new cluster ID: 2154968e9cff4ecaab57b587318e909a
I20260811 04:48:43.180419 24306 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:43.192381 24306 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:43.193222 24306 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:43.201079 24306 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1cbb7fd5f584e5d88e450eebd972e1f: Generated new TSK 0
I20260811 04:48:43.201732 24306 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:48:43.633307 24295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:43.209636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55230 (local address 127.17.188.126:38181)
0811 04:48:43.209762 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:43.209767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:43.209967 (+ 200us) server_negotiation.cc:407] Connection header received
0811 04:48:43.210110 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:43.210112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:43.210154 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:43.210254 (+ 100us) server_negotiation.cc:226] Negotiated authn=JWT
0811 04:48:43.210536 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.211067 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.212271 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.212462 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.212531 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:43.212856 (+ 325us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 04:48:43.632920 (+420064us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 04:48:43.633185 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55230: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:48:43.633471 24295 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55230: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 04:48:43.633584 24322 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:43.209518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38181 (local address 127.0.0.1:55230)
0811 04:48:43.209872 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:43.209886 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:43.210000 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:43.210283 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:43.210287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:43.210295 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 04:48:43.210430 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:43.210437 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.211181 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.211186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:43.212160 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:43.212171 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:43.212575 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:43.212580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:43.212677 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:43.212705 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 04:48:43.633174 (+420469us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 04:48:43.633390 (+ 216us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.17.188.126:38181: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":163,"threads_started":1}
I20260811 04:48:43.634337 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24220
2026-08-11T04:48:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (691 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (126 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (123 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:43 dist-test-slave-njxd krb5kdc[24335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:43 dist-test-slave-njxd krb5kdc[24335](info): set up 2 sockets
Aug 11 04:48:43 dist-test-slave-njxd krb5kdc[24335](info): commencing operation
krb5kdc: starting...
W20260811 04:48:44.978585 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:45.104049 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41551
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:45.214859 24350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:45.215144 24350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:45.215214 24350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:45.219157 24350 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:45.219237 24350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:45.219275 24350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:45.219333 24350 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:45.219372 24350 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:45.224505 24350 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:45.225566 24350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:45.226640 24350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:45.235157 24358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.235272 24361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:45.235181 24350 server_base.cc:1034] running on GCE node
W20260811 04:48:45.235198 24359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:45.235946 24350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:45.236966 24350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:45.238128 24350 hybrid_clock.cc:648] HybridClock initialized: now 1786423725238098 us; error 42 us; skew 500 ppm
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:45.240918 24350 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:45.241935 24350 webserver.cc:460] Webserver started at http://127.17.188.126:46721/ using document root <none> and password file <none>
I20260811 04:48:45.242473 24350 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:45.242533 24350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:45.242774 24350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:45.244858 24350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "efe36a00bf12493ea9bdf3495d258c70"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "ae789b7a9a1eae1aacdad0ab641b5db0"
server_key_iv: "7a24009f8c45c10e4dab21a64e4b2732"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.245473 24350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "efe36a00bf12493ea9bdf3495d258c70"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "ae789b7a9a1eae1aacdad0ab641b5db0"
server_key_iv: "7a24009f8c45c10e4dab21a64e4b2732"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.249066 24350 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:48:45.251410 24369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.252599 24350 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:45.252732 24350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "efe36a00bf12493ea9bdf3495d258c70"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "ae789b7a9a1eae1aacdad0ab641b5db0"
server_key_iv: "7a24009f8c45c10e4dab21a64e4b2732"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.252832 24350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:45.264199 24350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:45.267477 24350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:45.267695 24350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:45.274819 24350 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:41551
I20260811 04:48:45.274914 24424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:41551 every 8 connection(s)
I20260811 04:48:45.275817 24350 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:45.278671 24425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:45.279796 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24350
I20260811 04:48:45.279935 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:45.280267 18161 external_mini_cluster.cc:1428] Setting key 8452b150b034843086f0fa814e31779a
I20260811 04:48:45.284950 24425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70: Bootstrap starting.
I20260811 04:48:45.287591 24425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:45.288496 24425 log.cc:824] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70: Log is configured to *not* fsync() on all Append() calls
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:45.290558 24425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70: No bootstrap required, opened a new log
I20260811 04:48:45.294512 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.281686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43520 (local address 127.17.188.126:41551)
0811 04:48:45.282097 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:45.282114 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:45.282149 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:48:45.282757 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:45.282774 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:45.283086 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:45.283362 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:45.284238 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.285237 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.286396 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.286854 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.286975 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.289876 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:45.289881 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:45.289892 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:45.289917 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:45.291635 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.292152 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.292158 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.292162 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.292281 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.292650 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.292653 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.292654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.293023 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:45.293187 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:45.293462 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 04:48:45.293808 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":152,"threads_started":1}
I20260811 04:48:45.294624 24425 raft_consensus.cc:348] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } }
I20260811 04:48:45.294902 24425 raft_consensus.cc:374] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:45.294986 24425 raft_consensus.cc:729] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efe36a00bf12493ea9bdf3495d258c70, State: Initialized, Role: FOLLOWER
I20260811 04:48:45.295459 24425 consensus_queue.cc:260] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } }
I20260811 04:48:45.295603 24425 raft_consensus.cc:388] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:45.295670 24425 raft_consensus.cc:482] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:45.295760 24425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:45.296620 24425 raft_consensus.cc:504] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } }
I20260811 04:48:45.296976 24425 leader_election.cc:302] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efe36a00bf12493ea9bdf3495d258c70; no voters:
I20260811 04:48:45.297307 24425 leader_election.cc:288] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:45.297422 24430 raft_consensus.cc:2781] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:45.297716 24430 raft_consensus.cc:686] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [term 1 LEADER]: Becoming Leader. State: Replica: efe36a00bf12493ea9bdf3495d258c70, State: Running, Role: LEADER
I20260811 04:48:45.297995 24430 consensus_queue.cc:237] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } }
I20260811 04:48:45.298449 24425 sys_catalog.cc:564] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:45.299659 24432 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader efe36a00bf12493ea9bdf3495d258c70. Latest consensus state: current_term: 1 leader_uuid: "efe36a00bf12493ea9bdf3495d258c70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } }
I20260811 04:48:45.299808 24432 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:45.299659 24431 sys_catalog.cc:455] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efe36a00bf12493ea9bdf3495d258c70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efe36a00bf12493ea9bdf3495d258c70" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } }
I20260811 04:48:45.300067 24431 sys_catalog.cc:458] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:45.300302 24440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:45.303434 24440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:45.309262 24440 catalog_manager.cc:1347] Generated new cluster ID: e07f2a603ede43068625f01c5c81b66d
I20260811 04:48:45.309316 24440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:45.315521 24440 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:45.316684 24440 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:45.321166 24440 catalog_manager.cc:5868] T 00000000000000000000000000000000 P efe36a00bf12493ea9bdf3495d258c70: Generated new TSK 0
I20260811 04:48:45.321921 24440 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:45.356988 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:45.483413 24457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:45.483711 24457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:45.483788 24457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:45.487761 24457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:45.487843 24457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:45.487943 24457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:45.493031 24457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:45.494108 24457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:45.495141 24457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:45.505039 24463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.505054 24462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.505048 24465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:45.505309 24457 server_base.cc:1034] running on GCE node
I20260811 04:48:45.505861 24457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:45.506521 24457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:45.507714 24457 hybrid_clock.cc:648] HybridClock initialized: now 1786423725507705 us; error 30 us; skew 500 ppm
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:45.510394 24457 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:45.511204 24457 webserver.cc:460] Webserver started at http://127.17.188.65:35887/ using document root <none> and password file <none>
I20260811 04:48:45.511754 24457 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:45.511842 24457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:45.512080 24457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:45.514210 24457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "2868b1e850d5464aa6765915832e31b7"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "5cdca39231bd99974a2df13e012bf8a6"
server_key_iv: "a4871eee185af9355d8fad3bfa072dfe"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.514803 24457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "2868b1e850d5464aa6765915832e31b7"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "5cdca39231bd99974a2df13e012bf8a6"
server_key_iv: "a4871eee185af9355d8fad3bfa072dfe"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.518589 24457 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:45.521442 24472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.523141 24457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:45.523317 24457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "2868b1e850d5464aa6765915832e31b7"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "5cdca39231bd99974a2df13e012bf8a6"
server_key_iv: "a4871eee185af9355d8fad3bfa072dfe"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.523448 24457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:45.535445 24457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:45.538250 24457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:45.538455 24457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:45.539036 24457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:45.539858 24457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:45.539930 24457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.540001 24457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:45.540043 24457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.548709 24457 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37355
I20260811 04:48:45.548730 24595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37355 every 8 connection(s)
I20260811 04:48:45.549549 24457 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:45.554658 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24457
I20260811 04:48:45.554787 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:45.555130 18161 external_mini_cluster.cc:1428] Setting key 76f689b81b97b3bd6007db142b01d28c
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:45.564206 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.551439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:45985 (local address 127.17.188.126:41551)
0811 04:48:45.551597 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:45.551602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:45.552404 (+ 802us) server_negotiation.cc:407] Connection header received
0811 04:48:45.553766 (+ 1362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:45.553768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:45.553816 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:45.553889 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:45.555372 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.555940 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.557134 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.557366 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.557474 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.560331 (+ 2857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:45.560334 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:45.560337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:45.560361 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:45.561969 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.562601 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.562604 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.562605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.562680 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.563081 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.563083 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.563084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.563257 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:45.563331 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:45.563970 (+ 639us) server_negotiation.cc:299] Negotiation successful
0811 04:48:45.564075 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:48:45.565392 24598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.551801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.17.188.65:45985)
0811 04:48:45.552252 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:45.552295 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:45.553519 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:45.554051 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:45.554058 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:45.554460 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:45.555196 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.555219 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.556068 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.556072 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.556977 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.557013 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.557518 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.557522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.557763 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.558363 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:45.558379 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:45.560144 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:45.562085 (+ 1941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:45.562095 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:45.562122 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:45.562497 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:45.562769 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:45.562774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:45.562778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:45.562979 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:45.563363 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:45.563372 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:45.563705 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 04:48:45.563928 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 04:48:45.564294 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":113,"threads_started":1}
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:45.566668 24596 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41551
I20260811 04:48:45.566913 24596 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:45.567477 24596 heartbeater.cc:511] Master 127.17.188.126:41551 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:45.569037 24388 ts_manager.cc:194] Registered new tserver with Master: 2868b1e850d5464aa6765915832e31b7 (127.17.188.65:37355)
I20260811 04:48:45.570750 24388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:45985
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:45.585460 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:45.696244 24601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:45.696553 24601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:45.696632 24601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:45.700891 24601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:45.700946 24601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:45.701004 24601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:45.706077 24601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:45.707029 24601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:45.708002 24601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:45.717566 24607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.717600 24610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.717667 24608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:45.717736 24601 server_base.cc:1034] running on GCE node
I20260811 04:48:45.718241 24601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:45.718851 24601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:45.720012 24601 hybrid_clock.cc:648] HybridClock initialized: now 1786423725719995 us; error 28 us; skew 500 ppm
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:45.722918 24601 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:45.723774 24601 webserver.cc:460] Webserver started at http://127.17.188.66:45247/ using document root <none> and password file <none>
I20260811 04:48:45.724332 24601 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:45.724444 24601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:45.724782 24601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:45.727234 24601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "e972a7a8bdb74c8ca53096b512ad4406"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "0cd82a226c9b5dc99722f72254177e1c"
server_key_iv: "1baee4623ee15a247b89720718b6131b"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.727931 24601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "e972a7a8bdb74c8ca53096b512ad4406"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "0cd82a226c9b5dc99722f72254177e1c"
server_key_iv: "1baee4623ee15a247b89720718b6131b"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.732288 24601 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:45.735459 24617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.737393 24601 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:45.737528 24601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "e972a7a8bdb74c8ca53096b512ad4406"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "0cd82a226c9b5dc99722f72254177e1c"
server_key_iv: "1baee4623ee15a247b89720718b6131b"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.737668 24601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:45.751686 24601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:45.754956 24601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:45.755168 24601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:45.755859 24601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:45.756752 24601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:45.756798 24601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.756860 24601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:45.756891 24601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.767377 24601 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:40561
I20260811 04:48:45.767452 24740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:40561 every 8 connection(s)
I20260811 04:48:45.768260 24601 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:45.772372 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24601
I20260811 04:48:45.772511 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:45.772799 18161 external_mini_cluster.cc:1428] Setting key 26f2000846b177e3bd08dd087e3d5436
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:45.784144 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.770501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:40337 (local address 127.17.188.126:41551)
0811 04:48:45.770639 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:45.770643 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:45.771639 (+ 996us) server_negotiation.cc:407] Connection header received
0811 04:48:45.773888 (+ 2249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:45.773891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:45.773936 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:45.774018 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:45.775939 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.776647 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.777873 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.778097 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.778204 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.780671 (+ 2467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:45.780674 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:45.780676 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:45.780698 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:45.782172 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.782677 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.782682 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.782684 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.782761 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:45.783110 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:45.783114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:45.783115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:45.783286 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:45.783392 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:45.783867 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 04:48:45.783977 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:48:45.784974 24743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.770873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.17.188.66:40337)
0811 04:48:45.771433 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:45.771498 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:45.773650 (+ 2152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:45.774219 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:45.774230 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:45.774891 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:45.775691 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.775715 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.776779 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.776784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.777756 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.777766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.778255 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.778259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.778423 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.779017 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:45.779034 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:45.780497 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:45.782293 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:45.782299 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:45.782327 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:45.782571 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:45.782869 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:45.782873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:45.782875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:45.783013 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:45.783391 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:45.783398 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:45.783637 (+ 239us) client_negotiation.cc:769] Sending connection context
0811 04:48:45.783810 (+ 173us) client_negotiation.cc:240] Negotiation successful
0811 04:48:45.784109 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":116,"threads_started":1}
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:45.786144 24741 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41551
I20260811 04:48:45.786370 24741 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:45.786837 24741 heartbeater.cc:511] Master 127.17.188.126:41551 requested a full tablet report, sending...
I20260811 04:48:45.787868 24388 ts_manager.cc:194] Registered new tserver with Master: e972a7a8bdb74c8ca53096b512ad4406 (127.17.188.66:40561)
I20260811 04:48:45.788589 24388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:40337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:45.808672 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:36729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:45.920146 24746 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:45.920363 24746 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:45.920403 24746 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:45.924218 24746 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:45.924268 24746 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:45.924319 24746 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:45.929418 24746 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:36729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24746
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:45.930419 24746 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:45.931360 24746 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:45.940815 24757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.940855 24754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:45.940855 24755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:45.941105 24746 server_base.cc:1034] running on GCE node
I20260811 04:48:45.941636 24746 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:45.942314 24746 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:45.943495 24746 hybrid_clock.cc:648] HybridClock initialized: now 1786423725943468 us; error 40 us; skew 500 ppm
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:45.946326 24746 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:45.947135 24746 webserver.cc:460] Webserver started at http://127.17.188.67:46165/ using document root <none> and password file <none>
I20260811 04:48:45.947687 24746 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:45.947746 24746 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:45.947970 24746 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:45.949980 24746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "8846de1d7db44259a3cc0dacffbed50d"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "e152d092f3c4bb2956d3e182a1cf157e"
server_key_iv: "5f8eb9d28e36893d7b43033d4b548ec9"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.950536 24746 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "8846de1d7db44259a3cc0dacffbed50d"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "e152d092f3c4bb2956d3e182a1cf157e"
server_key_iv: "5f8eb9d28e36893d7b43033d4b548ec9"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.954164 24746 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:45.956549 24766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.957829 24746 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:45.957957 24746 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "8846de1d7db44259a3cc0dacffbed50d"
format_stamp: "Formatted at 2026-08-11 04:48:45 on dist-test-slave-njxd"
server_key: "e152d092f3c4bb2956d3e182a1cf157e"
server_key_iv: "5f8eb9d28e36893d7b43033d4b548ec9"
server_key_version: "encryptionkey@0"
I20260811 04:48:45.958068 24746 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:45.974463 24746 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:45.977460 24746 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:45.977700 24746 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:45.978320 24746 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:45.979152 24746 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:45.979221 24746 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.979293 24746 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:45.979336 24746 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:45.987792 24746 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:35015
I20260811 04:48:45.987820 24893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:35015 every 8 connection(s)
I20260811 04:48:45.988652 24746 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:45.996281 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24746
I20260811 04:48:45.996433 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:45.996822 18161 external_mini_cluster.cc:1428] Setting key cb78fab8d9ee91037cf9cba88be53f54
Aug 11 04:48:45 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423725, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:46.002491 24428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.990441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:44273 (local address 127.17.188.126:41551)
0811 04:48:45.990578 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:45.990581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:45.991391 (+ 810us) server_negotiation.cc:407] Connection header received
0811 04:48:45.992669 (+ 1278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:45.992672 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:45.992720 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:45.992795 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:45.994024 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.994566 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.995645 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.995860 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.995933 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.998752 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:45.998758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:45.998763 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:45.998793 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:46.000371 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.000917 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.000920 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.000924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.001011 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.001370 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.001373 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.001375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.001564 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:46.001711 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:46.002205 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 04:48:46.002332 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:48:46.003233 24896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:45.990794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.17.188.67:44273)
0811 04:48:45.991239 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:45.991283 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:45.992458 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:45.992957 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:45.992964 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:45.993325 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:45.993885 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.993900 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.994684 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.994687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.995529 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:45.995538 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:45.995981 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:45.995984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:45.996125 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:45.996771 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:45.996791 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:45.998543 (+ 1752us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:46.000491 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:46.000509 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:46.000523 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:46.000793 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:46.001105 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:46.001111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:46.001115 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:46.001267 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:46.001696 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:46.001703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:46.001944 (+ 241us) client_negotiation.cc:769] Sending connection context
0811 04:48:46.002146 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 04:48:46.002457 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":107,"threads_started":1}
I20260811 04:48:46.004236 24894 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41551
I20260811 04:48:46.004459 24894 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:46.004920 24894 heartbeater.cc:511] Master 127.17.188.126:41551 requested a full tablet report, sending...
I20260811 04:48:46.005975 24388 ts_manager.cc:194] Registered new tserver with Master: 8846de1d7db44259a3cc0dacffbed50d (127.17.188.67:35015)
I20260811 04:48:46.006537 24388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:44273
I20260811 04:48:46.010789 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/test-admin.keytab.
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.026744 18161 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 04:48:46.030011 24901 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:46.028456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39086 (local address 127.17.188.65:37355)
0811 04:48:46.028746 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.028764 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.028793 (+ 29us) server_negotiation.cc:407] Connection header received
0811 04:48:46.028856 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.028863 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.029049 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.029203 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.029804 (+ 601us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39086: BlockingRecv error: recv got EOF from 127.0.0.1:39086 (error 108)
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":67,"threads_started":1}
W20260811 04:48:46.030117 18161 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc' of type FILE
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.031157 18161 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.032055 18161 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:46.041772 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:46.032893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39098 (local address 127.17.188.65:37355)
0811 04:48:46.033052 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.033056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.033071 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:48:46.033181 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.033183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.033220 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.033290 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.033944 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.034735 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.035518 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.035877 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.035960 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:46.038318 (+ 2358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:46.038328 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:46.038342 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:46.038365 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:46.040120 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.040534 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.040539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.040541 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.040620 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.040846 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.040849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.040850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.041073 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:46.041239 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:46.041440 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 04:48:46.041563 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 04:48:46.045542 24901 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:46.044589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39106 (local address 127.17.188.65:37355)
0811 04:48:46.044695 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.044699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.044765 (+ 66us) server_negotiation.cc:407] Connection header received
0811 04:48:46.044905 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.044908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.044950 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.045028 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.045430 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39106: BlockingRecv error: recv got EOF from 127.0.0.1:39106 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:48:46.045717 18161 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc' of type FILE
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.046746 18161 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.047628 18161 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:46.055830 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:46.048390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39114 (local address 127.17.188.65:37355)
0811 04:48:46.048504 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.048510 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.048635 (+ 125us) server_negotiation.cc:407] Connection header received
0811 04:48:46.048718 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.048720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.048754 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.048815 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.049274 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.049837 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.050550 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.050797 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.050871 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:46.052899 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:46.052902 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:46.052903 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:46.052924 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:46.054408 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.054788 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.054791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.054792 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.054862 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.055089 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.055091 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.055092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.055239 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:46.055331 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:46.055522 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 04:48:46.055649 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:48:46.058437 24901 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:46.057565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.17.188.65:37355)
0811 04:48:46.057709 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.057713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.057812 (+ 99us) server_negotiation.cc:407] Connection header received
0811 04:48:46.057905 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.057907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.057938 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.057996 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.058334 (+ 338us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39124: BlockingRecv error: recv got EOF from 127.0.0.1:39124 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:48:46.058526 18161 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786423695299078-18161-0/krb5kdc/krb5cc' of type FILE
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.059504 18161 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:46.060413 18161 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24335](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:48:46.068698 24901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:46.061191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39134 (local address 127.17.188.65:37355)
0811 04:48:46.061342 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:46.061345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:46.061433 (+ 88us) server_negotiation.cc:407] Connection header received
0811 04:48:46.061541 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:46.061543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:46.061640 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:46.061713 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:46.062137 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.062682 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.063410 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:46.063624 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:46.063698 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:46.065806 (+ 2108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:46.065809 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:46.065811 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:46.065832 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:46.067256 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.067652 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.067654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.067655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.067727 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:46.067951 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:46.067953 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:46.067954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:46.068092 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:46.068183 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:46.068376 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 04:48:46.068491 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 04:48:46.069818 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24457
I20260811 04:48:46.078241 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24601
I20260811 04:48:46.087155 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24746
I20260811 04:48:46.095589 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24350
2026-08-11T04:48:46Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2212 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24918](info): set up 2 sockets
Aug 11 04:48:46 dist-test-slave-njxd krb5kdc[24918](info): commencing operation
krb5kdc: starting...
W20260811 04:48:47.168949 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:47Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab.
Entry for principal oryx/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab.
I20260811 04:48:47.292912 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42863
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab
--principal=oryx/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42863
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:47.403456 24931 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:47.403739 24931 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:47.403815 24931 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:47.407809 24931 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:47.407892 24931 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:47.407928 24931 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:47.407985 24931 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:47.408025 24931 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:47.413085 24931 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42863
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab
--principal=oryx/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42863
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24931
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:47.414163 24931 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:47.415203 24931 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:47.423353 24939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.423329 24937 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.423318 24936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:47.423722 24931 server_base.cc:1034] running on GCE node
I20260811 04:48:47.424325 24931 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:47.425328 24931 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:47.426486 24931 hybrid_clock.cc:648] HybridClock initialized: now 1786423727426462 us; error 34 us; skew 500 ppm
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:47.433305 24931 init.cc:377] Logged in from keytab as oryx/127.17.188.126@KRBTEST.COM (short username oryx)
I20260811 04:48:47.434249 24931 webserver.cc:460] Webserver started at http://127.17.188.126:39545/ using document root <none> and password file <none>
I20260811 04:48:47.434836 24931 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:47.434931 24931 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:47.435175 24931 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:47.437224 24931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "6f7b5b31db2148f4b318740a4c1aece8"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "404eac2f823b0be1e5ee217fa095b64c"
server_key_iv: "1860fa67f6e99e6abc03b8c3f20e6013"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.437834 24931 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "6f7b5b31db2148f4b318740a4c1aece8"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "404eac2f823b0be1e5ee217fa095b64c"
server_key_iv: "1860fa67f6e99e6abc03b8c3f20e6013"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.442080 24931 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:48:47.444535 24947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:47.445879 24931 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:47.446019 24931 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "6f7b5b31db2148f4b318740a4c1aece8"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "404eac2f823b0be1e5ee217fa095b64c"
server_key_iv: "1860fa67f6e99e6abc03b8c3f20e6013"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.446144 24931 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:47.469833 24931 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:47.472641 24931 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:47.472851 24931 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:47.480096 24931 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:42863
I20260811 04:48:47.480377 25004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:42863 every 8 connection(s)
I20260811 04:48:47.481135 24931 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:47.484042 25005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:47.489475 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 24931
I20260811 04:48:47.489662 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:47.489686 25005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Bootstrap starting.
I20260811 04:48:47.490000 18161 external_mini_cluster.cc:1428] Setting key 6a648605a81121cbcfc40b558abf9c66
I20260811 04:48:47.492425 25005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:47.493247 25005 log.cc:824] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:47.495357 25005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: No bootstrap required, opened a new log
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:47.499948 25005 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } }
I20260811 04:48:47.500264 25005 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:47.500344 25005 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f7b5b31db2148f4b318740a4c1aece8, State: Initialized, Role: FOLLOWER
I20260811 04:48:47.500845 25005 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } }
I20260811 04:48:47.501045 25005 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:47.501128 25005 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:47.501235 25005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:47.502259 25005 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } }
I20260811 04:48:47.502697 25005 leader_election.cc:302] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f7b5b31db2148f4b318740a4c1aece8; no voters:
I20260811 04:48:47.503079 25005 leader_election.cc:288] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:47.503161 25013 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:47.503360 25013 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f7b5b31db2148f4b318740a4c1aece8, State: Running, Role: LEADER
I20260811 04:48:47.503664 25013 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } }
I20260811 04:48:47.504447 25005 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:47.504894 25013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7b5b31db2148f4b318740a4c1aece8. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } }
I20260811 04:48:47.505030 25013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:47.505407 25014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } }
I20260811 04:48:47.505558 25014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:47.505643 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:47.491378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41738 (local address 127.17.188.126:42863)
0811 04:48:47.491809 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:47.491825 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:47.491860 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:48:47.492529 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:47.492556 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:47.492907 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:47.493192 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:47.494163 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.495180 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.496343 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.496819 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.496945 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:47.499985 (+ 3040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:47.499991 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:47.500004 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:47.500056 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:47.502048 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:47.502607 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:47.502613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:47.502619 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:47.502743 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:47.503033 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:47.503038 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:47.503039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:47.503619 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:47.503811 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:47.504168 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 04:48:47.504497 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":142,"threads_started":1}
I20260811 04:48:47.506130 25017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:47.509323 25017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:47.514763 25017 catalog_manager.cc:1347] Generated new cluster ID: 453be9c7eb924d79bc54fe35978d6831
I20260811 04:48:47.514840 25017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:47.539122 25017 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:47.540514 25017 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:47.547849 25017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Generated new TSK 0
I20260811 04:48:47.548655 25017 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
I20260811 04:48:47.590591 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:47.728478 25034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:47.728744 25034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:47.728785 25034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:47.732765 25034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:47.732825 25034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:47.732904 25034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:47.738181 25034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:47.739262 25034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:47.740285 25034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:47.749424 25043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.749447 25040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.749431 25039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:47.749725 25034 server_base.cc:1034] running on GCE node
I20260811 04:48:47.750176 25034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:47.750823 25034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:47.752003 25034 hybrid_clock.cc:648] HybridClock initialized: now 1786423727751986 us; error 29 us; skew 500 ppm
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:47.754724 25034 init.cc:377] Logged in from keytab as oryx/127.17.188.65@KRBTEST.COM (short username oryx)
I20260811 04:48:47.755535 25034 webserver.cc:460] Webserver started at http://127.17.188.65:40125/ using document root <none> and password file <none>
I20260811 04:48:47.756037 25034 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:47.756096 25034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:47.756255 25034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:47.758267 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "ad4316a6b21e498ea33b53b7eff85899"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "abedffac6b556854d9e6231e7facc17b"
server_key_iv: "f2b1bb2cff6d56256e49d2dc74eb21f9"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.758787 25034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "ad4316a6b21e498ea33b53b7eff85899"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "abedffac6b556854d9e6231e7facc17b"
server_key_iv: "f2b1bb2cff6d56256e49d2dc74eb21f9"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.762225 25034 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:47.764427 25050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:47.765559 25034 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:47.765724 25034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "ad4316a6b21e498ea33b53b7eff85899"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "abedffac6b556854d9e6231e7facc17b"
server_key_iv: "f2b1bb2cff6d56256e49d2dc74eb21f9"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.765820 25034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:47.791889 25034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:47.794981 25034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:47.795190 25034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:47.795823 25034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:47.796653 25034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:47.796707 25034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:47.796789 25034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:47.796821 25034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:47.806174 25034 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:42047
I20260811 04:48:47.806267 25170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:42047 every 8 connection(s)
I20260811 04:48:47.807130 25034 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:47.808432 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25034
I20260811 04:48:47.808590 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:47.808928 18161 external_mini_cluster.cc:1428] Setting key 81c7d586417f427ef3cc09345586eb51
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:48:47.821853 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:47.809111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:44685 (local address 127.17.188.126:42863)
0811 04:48:47.809254 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:47.809258 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:47.810336 (+ 1078us) server_negotiation.cc:407] Connection header received
0811 04:48:47.811745 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:47.811748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:47.811803 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:47.811881 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:47.813039 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.813737 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.814892 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.815341 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.815463 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:47.818046 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:47.818052 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:47.818057 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:47.818088 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:47.819648 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:47.820218 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:47.820222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:47.820224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:47.820307 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:47.820643 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:47.820647 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:47.820648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:47.820827 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:47.820936 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:47.821510 (+ 574us) server_negotiation.cc:299] Negotiation successful
0811 04:48:47.821674 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:47.822860 25173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:47.809630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:44685)
0811 04:48:47.810185 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:47.810240 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:47.811528 (+ 1288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:47.812052 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:47.812059 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:47.812429 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:47.812890 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:47.812903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.813866 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.813869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:47.814749 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:47.814758 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:47.815492 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:47.815495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:47.815647 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:47.816288 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:47.816305 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:47.817875 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:47.819775 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:47.819781 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:47.819796 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:47.820049 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:47.820401 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:47.820404 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:47.820406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:47.820545 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:47.820935 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:47.820942 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:47.821193 (+ 251us) client_negotiation.cc:769] Sending connection context
0811 04:48:47.821446 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 04:48:47.821866 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":176,"threads_started":1}
I20260811 04:48:47.824175 25171 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:47.824411 25171 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:47.824894 25171 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:47.826627 24964 ts_manager.cc:194] Registered new tserver with Master: ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
I20260811 04:48:47.828357 24964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:44685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
I20260811 04:48:47.840695 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:47.949012 25176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:47.949251 25176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:47.949357 25176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:47.953141 25176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:47.953198 25176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:47.953287 25176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:47.958520 25176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:47.959476 25176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:47.960431 25176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:47.969743 25187 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.969686 25183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:47.969686 25184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:47.970153 25176 server_base.cc:1034] running on GCE node
I20260811 04:48:47.970645 25176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:47.971292 25176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:47.972478 25176 hybrid_clock.cc:648] HybridClock initialized: now 1786423727972441 us; error 48 us; skew 500 ppm
Aug 11 04:48:47 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:47.975509 25176 init.cc:377] Logged in from keytab as oryx/127.17.188.66@KRBTEST.COM (short username oryx)
I20260811 04:48:47.976455 25176 webserver.cc:460] Webserver started at http://127.17.188.66:39765/ using document root <none> and password file <none>
I20260811 04:48:47.977015 25176 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:47.977108 25176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:47.977347 25176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:47.979427 25176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "4a901967c9be431da5e830a1da689906"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "c503e945dc74c896b4606bcbf8478652"
server_key_iv: "652606ac63cf861e48f92a9caa828723"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.979984 25176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "4a901967c9be431da5e830a1da689906"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "c503e945dc74c896b4606bcbf8478652"
server_key_iv: "652606ac63cf861e48f92a9caa828723"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.983858 25176 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:47.986272 25194 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:47.987512 25176 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:47.987675 25176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "4a901967c9be431da5e830a1da689906"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "c503e945dc74c896b4606bcbf8478652"
server_key_iv: "652606ac63cf861e48f92a9caa828723"
server_key_version: "encryptionkey@0"
I20260811 04:48:47.987782 25176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.010529 25176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:48.013347 25176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:48.013550 25176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:48.014190 25176 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:48.015079 25176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:48.015149 25176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.015223 25176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:48.015275 25176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.024247 25176 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:36341
I20260811 04:48:48.024271 25322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:36341 every 8 connection(s)
I20260811 04:48:48.025041 25176 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:48.027346 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25176
I20260811 04:48:48.027484 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:48.027833 18161 external_mini_cluster.cc:1428] Setting key ef29c36ff65ee2bc9e4a41e1d26dac78
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for oryx/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:48.039711 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.026728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44021 (local address 127.17.188.126:42863)
0811 04:48:48.026874 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.026879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.027843 (+ 964us) server_negotiation.cc:407] Connection header received
0811 04:48:48.029347 (+ 1504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.029350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.029401 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.029489 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.030661 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.031453 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.032573 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.032785 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.032892 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.035810 (+ 2918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.035813 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.035815 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.035837 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.037407 (+ 1570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.038076 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.038078 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.038079 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.038159 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.038584 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.038587 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.038588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.038760 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.038835 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.039408 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.039538 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:48.040550 25326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.027177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:44021)
0811 04:48:48.027655 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.027705 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.029121 (+ 1416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.029695 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.029701 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.030041 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.030504 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.030516 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.031586 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.031590 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.032438 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.032447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.032928 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.032932 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.033107 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.033716 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.033731 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.035599 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.037536 (+ 1937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.037544 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.037561 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.037969 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.038264 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.038269 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.038273 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.038456 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.038854 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.038859 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.039080 (+ 221us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.039340 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.039671 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":138,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.67@KRBTEST.COM" created.
I20260811 04:48:48.041829 25323 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:48.042076 25323 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:48.042676 25323 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:48.043816 24964 ts_manager.cc:194] Registered new tserver with Master: 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:48.044664 24964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:44021
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
I20260811 04:48:48.056702 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:48.160558 25329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:48.160791 25329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:48.160835 25329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:48.164361 25329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:48.164400 25329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:48.164449 25329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:48.169660 25329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42863
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:48.170583 25329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:48.171461 25329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:48.180464 25336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.180490 25339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.180527 25337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.180706 25329 server_base.cc:1034] running on GCE node
I20260811 04:48:48.181185 25329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:48.181806 25329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:48.182963 25329 hybrid_clock.cc:648] HybridClock initialized: now 1786423728182950 us; error 25 us; skew 500 ppm
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:48.185504 25329 init.cc:377] Logged in from keytab as oryx/127.17.188.67@KRBTEST.COM (short username oryx)
I20260811 04:48:48.186311 25329 webserver.cc:460] Webserver started at http://127.17.188.67:45067/ using document root <none> and password file <none>
I20260811 04:48:48.186874 25329 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.186964 25329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.187197 25329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:48.189106 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "acb001cea077401bbf79dc022f508749"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "64631e95f1ca8960bd6ffd454168363d"
server_key_iv: "d6aa3ab84e138f7514358d1761769861"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.189710 25329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "acb001cea077401bbf79dc022f508749"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "64631e95f1ca8960bd6ffd454168363d"
server_key_iv: "d6aa3ab84e138f7514358d1761769861"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.193442 25329 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:48.195780 25346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.196975 25329 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:48.197116 25329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "acb001cea077401bbf79dc022f508749"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "64631e95f1ca8960bd6ffd454168363d"
server_key_iv: "d6aa3ab84e138f7514358d1761769861"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.197221 25329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.210700 25329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:48.213331 25329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:48.213515 25329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:48.214105 25329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:48.214869 25329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:48.214941 25329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.215011 25329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:48.215054 25329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.223709 25329 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:41091
I20260811 04:48:48.223732 25468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:41091 every 8 connection(s)
I20260811 04:48:48.224521 25329 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:48.232823 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25329
I20260811 04:48:48.232949 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:48.233203 18161 external_mini_cluster.cc:1428] Setting key 4e4934bfdbe0a34a9745d76f6b421c17
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:48.237547 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.226281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56105 (local address 127.17.188.126:42863)
0811 04:48:48.226407 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.226411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.227147 (+ 736us) server_negotiation.cc:407] Connection header received
0811 04:48:48.228424 (+ 1277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.228427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.228472 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.228545 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.229561 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.230122 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.231155 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.231349 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.231419 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.233912 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.233915 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.233918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.233942 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.235545 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.236042 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.236045 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.236047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.236136 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.236481 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.236486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.236488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.236696 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.236807 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.237272 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.237385 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:48:48.238334 25471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.226580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:56105)
0811 04:48:48.226994 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.227037 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.228212 (+ 1175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.228707 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.228713 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.229030 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.229443 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.229455 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.230220 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.230222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.231041 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.231049 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.231469 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.231471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.231593 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.232189 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.232204 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.233760 (+ 1556us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.235663 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.235669 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.235682 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.235938 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.236227 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.236230 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.236232 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.236366 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.236807 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.236815 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.237046 (+ 231us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.237228 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.237524 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":101,"threads_started":1}
I20260811 04:48:48.239439 25469 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:48.239632 25469 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:48.240037 25469 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:48.240931 24964 ts_manager.cc:194] Registered new tserver with Master: acb001cea077401bbf79dc022f508749 (127.17.188.67:41091)
I20260811 04:48:48.241460 24964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:56105
I20260811 04:48:48.246687 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.188.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.125.keytab.
Entry for principal oryx/127.17.188.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.125.keytab.
I20260811 04:48:48.274501 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:43361
--webserver_interface=127.17.188.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.125.keytab
--principal=oryx/127.17.188.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42863,127.17.188.125:43361
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:48.387230 25474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:48.387466 25474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:48.387540 25474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:48.391641 25474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:48.391695 25474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:48.391714 25474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:48.391767 25474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:48.391794 25474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:48.397008 25474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42863,127.17.188.125:43361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.125.keytab
--principal=oryx/127.17.188.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:43361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.188.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
W20260811 04:48:48.397218 25474 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.17.188.126:42863,127.17.188.125:43361'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 04:48:48.398105 25474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:48.399123 25474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:48.408123 25480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.408193 25474 server_base.cc:1034] running on GCE node
W20260811 04:48:48.408147 25479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.408147 25482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.409056 25474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:48.410264 25474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:48.411420 25474 hybrid_clock.cc:648] HybridClock initialized: now 1786423728411407 us; error 28 us; skew 500 ppm
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:48.414206 25474 init.cc:377] Logged in from keytab as oryx/127.17.188.125@KRBTEST.COM (short username oryx)
I20260811 04:48:48.415258 25474 webserver.cc:460] Webserver started at http://127.17.188.125:45251/ using document root <none> and password file <none>
I20260811 04:48:48.415838 25474 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.415928 25474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.416272 25474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:48.418666 25474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/instance:
uuid: "fe1b5c1c5276477183326ef01027c5a6"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "82461fe50b120fcdd6debaec90513369"
server_key_iv: "cf1dec2d489f857ba764c872ecce3d74"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.419283 25474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal/instance:
uuid: "fe1b5c1c5276477183326ef01027c5a6"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "82461fe50b120fcdd6debaec90513369"
server_key_iv: "cf1dec2d489f857ba764c872ecce3d74"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.423509 25474 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:48.426259 25489 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.427587 25474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:48:48.427743 25474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "fe1b5c1c5276477183326ef01027c5a6"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "82461fe50b120fcdd6debaec90513369"
server_key_iv: "cf1dec2d489f857ba764c872ecce3d74"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.427870 25474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.444103 25474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:48.447386 25474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:48.447626 25474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:48.456089 25474 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.125:43361
I20260811 04:48:48.456422 25544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.125:43361 every 8 connection(s)
I20260811 04:48:48.457194 25474 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
I20260811 04:48:48.460183 25545 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:48.461902 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25474
I20260811 04:48:48.464563 25545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.125@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:48.476074 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.466699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41742 (local address 127.17.188.126:42863)
0811 04:48:48.466838 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.466842 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.467143 (+ 301us) server_negotiation.cc:407] Connection header received
0811 04:48:48.467308 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.467313 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.467363 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.467456 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.468129 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.468613 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.469809 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.470159 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.470280 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.472630 (+ 2350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.472634 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.472638 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.472670 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.474019 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474504 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.474508 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.474510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.474611 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474948 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.474951 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.474953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.475184 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.475347 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.475826 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.475926 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:48:48.476991 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.463493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.17.188.125:43361)
0811 04:48:48.463906 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.463922 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.463958 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:48:48.464559 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.464576 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.464960 (+ 384us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.465245 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.466244 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.467633 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.468470 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.469122 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.469305 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.472034 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.472039 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.472048 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.472069 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.474037 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474512 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.474518 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.474520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.474642 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474942 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.474947 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.474948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.475352 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.475661 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.475867 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.476181 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":85,"server-negotiator.queue_time_us":265,"thread_start_us":146,"threads_started":1}
I20260811 04:48:48.476990 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.466585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41742)
0811 04:48:48.467012 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.467050 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.467202 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.467504 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.467510 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.467861 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.467982 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.467987 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.468751 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.468754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.469567 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.469648 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.470317 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.470321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.470454 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.470978 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.470993 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.472479 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.474142 (+ 1663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474152 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.474162 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.474399 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.474714 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.474718 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.474720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.474840 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.475343 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.475349 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.475541 (+ 192us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.476232 (+ 691us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.476417 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":48,"thread_start_us":130,"threads_started":1}
I20260811 04:48:48.478487 25545 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.125@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
I20260811 04:48:48.486932 25549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.478978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:59980)
0811 04:48:48.479156 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.479170 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.479255 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.479493 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.479495 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.479619 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.479703 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.479707 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.481064 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.481066 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.481539 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.481546 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.482131 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.482134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.482202 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.482693 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.482705 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.483857 (+ 1152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.485553 (+ 1696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.485556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.485557 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.485850 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.486146 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.486148 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.486149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.486223 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.486583 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.486585 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.486658 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.486736 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.486825 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119}
I20260811 04:48:48.487084 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.479045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59980 (local address 127.17.188.125:43361)
0811 04:48:48.479157 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.479162 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.479228 (+ 66us) server_negotiation.cc:407] Connection header received
0811 04:48:48.479365 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.479368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.479405 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.479454 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.479820 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.480950 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.481690 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.482014 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.482117 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.483974 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.483978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.483980 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.484004 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.485448 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.485950 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.485953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.485955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.486038 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.486306 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.486309 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.486311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.486497 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.486587 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.486818 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.486922 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 04:48:48.490038 25545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Bootstrap starting.
I20260811 04:48:48.492429 25545 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:48.493182 25545 log.cc:824] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:48.495139 25545 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: No bootstrap required, opened a new log
I20260811 04:48:48.498170 25545 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } }
I20260811 04:48:48.498395 25545 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:48.498471 25545 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe1b5c1c5276477183326ef01027c5a6, State: Initialized, Role: FOLLOWER
I20260811 04:48:48.498919 25545 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } }
I20260811 04:48:48.499382 25552 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } }
I20260811 04:48:48.499500 25552 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:48.500223 25545 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 04:48:48.505183 25564 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:48:48.505278 25564 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:48:48.507296 25474 master_runner.cc:428] Detected that this master fe1b5c1c5276477183326ef01027c5a6 is joining an existing cluster
I20260811 04:48:48.507373 25474 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.188.125:43361
I20260811 04:48:48.518422 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.509934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59990 (local address 127.17.188.125:43361)
0811 04:48:48.510036 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.510040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.510486 (+ 446us) server_negotiation.cc:407] Connection header received
0811 04:48:48.510627 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.510633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.510681 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.510754 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.511278 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.512043 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.513183 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.513412 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.513506 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.514930 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.514934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.514937 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.514962 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.516666 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517106 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.517111 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.517113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.517202 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517474 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.517479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.517481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.517738 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.517840 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.518104 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.518259 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":39}
I20260811 04:48:48.518433 25572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.510091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:59990)
0811 04:48:48.510373 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.510388 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.510498 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.510851 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.510853 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.511039 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.511137 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.511142 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.512172 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.512175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.513034 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.513041 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.513650 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.513654 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.513786 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.514285 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.514299 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.514785 (+ 486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.516794 (+ 2009us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.516799 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.516801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.517002 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.517298 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517301 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.517303 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.517385 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.517838 (+ 453us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.517841 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.517945 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.518059 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.518206 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"spinlock_wait_cycles":5376,"thread_start_us":98,"threads_started":1}
I20260811 04:48:48.518989 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.509784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41750 (local address 127.17.188.126:42863)
0811 04:48:48.509926 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.509931 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.510330 (+ 399us) server_negotiation.cc:407] Connection header received
0811 04:48:48.510547 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.510551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.510605 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.510689 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.511251 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.511798 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.512988 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.513334 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.513448 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.515270 (+ 1822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.515274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.515277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.515309 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.516999 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517533 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.517536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.517538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.517653 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517987 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.517991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.517993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.518213 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.518293 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.518707 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.518827 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:48.519522 25571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.509729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41750)
0811 04:48:48.510239 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.510253 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.510405 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.510698 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.510701 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.510968 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.511110 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.511118 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.511920 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.511923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.512847 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.512857 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.513474 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.513480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.513556 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.514145 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.514157 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.514785 (+ 628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.517126 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517129 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.517131 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.517401 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.517765 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.517768 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.517770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.517867 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.518422 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.518425 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.518513 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.519136 (+ 623us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.519274 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":1,"spinlock_wait_cycles":2432,"thread_start_us":182,"threads_started":1}
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.126@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
I20260811 04:48:48.533958 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.524105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:60002)
0811 04:48:48.524443 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.524495 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.524660 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.524980 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.524985 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.525339 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.525443 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.525449 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.526473 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.526476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.527127 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.527136 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.527689 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.527691 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.527768 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.528360 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.528372 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.530104 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.531981 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.531993 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.532003 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.532333 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.532699 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.532702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.532704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.532807 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.533261 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.533268 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.533394 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.533539 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.533775 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":96,"threads_started":1}
I20260811 04:48:48.534444 25548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.524137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60002 (local address 127.17.188.125:43361)
0811 04:48:48.524259 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.524264 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.524570 (+ 306us) server_negotiation.cc:407] Connection header received
0811 04:48:48.524799 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.524803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.524854 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.524937 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.525555 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.526344 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.527241 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.527573 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.527682 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.530235 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.530239 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.530242 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.530268 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.531867 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.532500 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.532506 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.532511 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.532600 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.532920 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.532923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.532925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.533121 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.533207 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.534175 (+ 968us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.534284 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:48.535848 24964 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.188.125:43361: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6"
member_type: NON_VOTER
last_known_addr {
host: "127.17.188.125"
port: 43361
}
attrs {
promote: true
}
}
dest_uuid: "6f7b5b31db2148f4b318740a4c1aece8"
cas_config_opid_index: -1
I20260811 04:48:48.536677 24964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } }
I20260811 04:48:48.538914 25575 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.539566 25517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:48.540683 25575 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.188.125:43361
I20260811 04:48:48.540994 25517 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 04:48:48.541016 25575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.541100 25575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:48.541338 25474 master.cc:537] Master@127.17.188.125:43361 shutting down...
I20260811 04:48:48.541738 25576 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 04:48:48.543756 24949 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 04:48:48.544659 24949 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 -> Peer fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125:43361): Couldn't send request to peer fe1b5c1c5276477183326ef01027c5a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
WARNING: no policy specified for oryx/127.17.188.124@KRBTEST.COM; defaulting to no policy
I20260811 04:48:48.546293 25474 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:48.546583 25474 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:48.546706 25474 tablet_replica.cc:330] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.124@KRBTEST.COM" created.
I20260811 04:48:48.551865 25474 master.cc:552] Master@127.17.188.125:43361 shutdown complete.
I20260811 04:48:48.551908 25474 master_runner.cc:305] Clearing existing system tablet
I20260811 04:48:48.552147 25474 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.552194 25474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.553328 25474 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 04:48:48.554306 25582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.554515 25474 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.554664 25474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 04:48:48.554699 25474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "fe1b5c1c5276477183326ef01027c5a6"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "82461fe50b120fcdd6debaec90513369"
server_key_iv: "cf1dec2d489f857ba764c872ecce3d74"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.556667 25474 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:48.559060 25474 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 04:48:48.559149 25474 log.cc:1196] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 04:48:48.559392 25474 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Deleting consensus metadata
I20260811 04:48:48.559554 25474 master_runner.cc:315] Copying system tablet from 127.17.188.126:42863
I20260811 04:48:48.560689 25474 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: tablet copy: Beginning tablet copy session from remote peer at address 127.17.188.126:42863
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.124.keytab.
Entry for principal oryx/127.17.188.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.124.keytab.
I20260811 04:48:48.568048 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:40133
--webserver_interface=127.17.188.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.124.keytab
--principal=oryx/127.17.188.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:48:48.569416 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.561282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41762 (local address 127.17.188.126:42863)
0811 04:48:48.561424 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.561429 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.561533 (+ 104us) server_negotiation.cc:407] Connection header received
0811 04:48:48.561702 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.561705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.561756 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.561844 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.562316 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.563014 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.563915 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.564194 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.564335 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.565993 (+ 1658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.565995 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.565997 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.566019 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.567676 (+ 1657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.568155 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.568158 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.568160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.568241 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.568522 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.568525 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.568527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.568735 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.568800 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.569151 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.569261 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 04:48:48.569989 25588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.561181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41762)
0811 04:48:48.561432 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.561448 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.561564 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.561871 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.561874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.562093 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.562195 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.562201 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.563133 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.563136 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.563767 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.563776 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.564324 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.564328 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.564419 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.565386 (+ 967us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.565397 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.565852 (+ 455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.567808 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.567811 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.567813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.568048 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.568343 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.568345 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.568347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.568426 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.568870 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.568872 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.568960 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.569676 (+ 716us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.569810 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":245,"threads_started":1}
I20260811 04:48:48.570714 24988 tablet_copy_service.cc:140] P 6f7b5b31db2148f4b318740a4c1aece8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fe1b5c1c5276477183326ef01027c5a6 ({username='oryx', principal='oryx/127.17.188.125@KRBTEST.COM'} at 127.0.0.1:41762)
I20260811 04:48:48.570900 24988 tablet_copy_service.cc:161] P 6f7b5b31db2148f4b318740a4c1aece8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fe1b5c1c5276477183326ef01027c5a6 at {username='oryx', principal='oryx/127.17.188.125@KRBTEST.COM'} at 127.0.0.1:41762: session id = fe1b5c1c5276477183326ef01027c5a6-00000000000000000000000000000000
I20260811 04:48:48.573060 24988 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 04:48:48.574795 25474 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 04:48:48.576930 25474 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: tablet copy: Starting download of 0 data blocks...
I20260811 04:48:48.577153 25474 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: tablet copy: Starting download of 1 WAL segments...
I20260811 04:48:48.578997 25474 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 04:48:48.581157 24988 tablet_copy_service.cc:342] P 6f7b5b31db2148f4b318740a4c1aece8: Request end of tablet copy session fe1b5c1c5276477183326ef01027c5a6-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.188.125@KRBTEST.COM'} at 127.0.0.1:41762
I20260811 04:48:48.581267 24988 tablet_copy_service.cc:433] P 6f7b5b31db2148f4b318740a4c1aece8: ending tablet copy session fe1b5c1c5276477183326ef01027c5a6-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fe1b5c1c5276477183326ef01027c5a6
I20260811 04:48:48.589347 25474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:48.590981 25590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.591073 25593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.591302 25591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.591548 25474 server_base.cc:1034] running on GCE node
I20260811 04:48:48.591681 25474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:48.591960 25474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:48.593104 25474 hybrid_clock.cc:648] HybridClock initialized: now 1786423728593086 us; error 28 us; skew 500 ppm
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:48.594866 25474 init.cc:377] Logged in from keytab as oryx/127.17.188.125@KRBTEST.COM (short username oryx)
I20260811 04:48:48.595319 25474 webserver.cc:460] Webserver started at http://127.17.188.125:44669/ using document root <none> and password file <none>
I20260811 04:48:48.595510 25474 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.595543 25474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.596765 25474 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:48.597729 25600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.597970 25474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:48.598028 25474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "fe1b5c1c5276477183326ef01027c5a6"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "82461fe50b120fcdd6debaec90513369"
server_key_iv: "cf1dec2d489f857ba764c872ecce3d74"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.598095 25474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.616789 25474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:48.618857 25474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:48.623706 25474 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.125:43361
I20260811 04:48:48.623739 25659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.125:43361 every 8 connection(s)
I20260811 04:48:48.624264 25474 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
I20260811 04:48:48.626142 25661 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:48:48.627149 25661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Bootstrap starting.
I20260811 04:48:48.637285 25661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:48:48.637640 25661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: Bootstrap complete.
I20260811 04:48:48.638181 25661 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } }
I20260811 04:48:48.638319 25661 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fe1b5c1c5276477183326ef01027c5a6, State: Initialized, Role: LEARNER
I20260811 04:48:48.638437 25661 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } }
I20260811 04:48:48.638792 25665 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.638906 25661 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:48.638978 25665 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: LEARNER
I20260811 04:48:48.642304 25677 catalog_manager.cc:1259] Loaded cluster ID: 453be9c7eb924d79bc54fe35978d6831
I20260811 04:48:48.642359 25677 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: loading cluster ID for follower catalog manager: success
I20260811 04:48:48.644366 25677 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: acquiring CA information for follower catalog manager: success
I20260811 04:48:48.645761 25677 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 04:48:48.704111 25589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:48.704417 25589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:48.704509 25589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:48.708715 25589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:48.708791 25589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:48.708827 25589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:48.708876 25589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:48.708912 25589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:48.714207 25589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.124.keytab
--principal=oryx/127.17.188.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:40133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.188.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:48.715296 25589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:48.716310 25589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:48.724916 25685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.725064 25682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.724942 25683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.725289 25589 server_base.cc:1034] running on GCE node
I20260811 04:48:48.725891 25589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:48.726927 25589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:48.728114 25589 hybrid_clock.cc:648] HybridClock initialized: now 1786423728728099 us; error 32 us; skew 500 ppm
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:48.731485 25589 init.cc:377] Logged in from keytab as oryx/127.17.188.124@KRBTEST.COM (short username oryx)
I20260811 04:48:48.732359 25589 webserver.cc:460] Webserver started at http://127.17.188.124:42597/ using document root <none> and password file <none>
I20260811 04:48:48.732923 25589 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.732982 25589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.733187 25589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:48.735402 25589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/instance:
uuid: "5239d8681e0a45519e3822e184106118"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "9b354e5875a026b7b727792daa24b02d"
server_key_iv: "2235cd57661c796fba130102b96d56f8"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.736023 25589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal/instance:
uuid: "5239d8681e0a45519e3822e184106118"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "9b354e5875a026b7b727792daa24b02d"
server_key_iv: "2235cd57661c796fba130102b96d56f8"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.740134 25589 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 04:48:48.742630 25693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.743784 25589 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:48.743918 25589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "5239d8681e0a45519e3822e184106118"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "9b354e5875a026b7b727792daa24b02d"
server_key_iv: "2235cd57661c796fba130102b96d56f8"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.744022 25589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.756163 25589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:48.759388 25589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:48.759666 25589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:48.771584 25589 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.124:40133
I20260811 04:48:48.771950 25749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.124:40133 every 8 connection(s)
I20260811 04:48:48.772657 25589 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
I20260811 04:48:48.775684 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25589
I20260811 04:48:48.776194 25750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:48.781740 25750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.124@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:48.794178 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.783614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41774 (local address 127.17.188.126:42863)
0811 04:48:48.783736 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.783741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.784013 (+ 272us) server_negotiation.cc:407] Connection header received
0811 04:48:48.784221 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.784227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.784286 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.784373 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.785200 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.786150 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.787290 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.787545 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.787682 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.790310 (+ 2628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.790314 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.790317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.790343 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.791919 (+ 1576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792569 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.792575 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.792585 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.792679 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792990 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.792996 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.793001 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.793235 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.793342 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.793809 (+ 467us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.793936 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:48:48.794740 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.777261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38962 (local address 127.17.188.124:40133)
0811 04:48:48.777842 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.777862 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.777905 (+ 43us) server_negotiation.cc:407] Connection header received
0811 04:48:48.778995 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.779020 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.779408 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.779758 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.780745 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.782816 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.783974 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.784627 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.784781 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.788368 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.788376 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.788398 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.788439 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.791597 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792139 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.792147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.792152 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.792282 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792586 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.792590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.792592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.793087 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.793285 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.793593 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.793879 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":124,"threads_started":1}
I20260811 04:48:48.796027 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.783435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41774)
0811 04:48:48.783892 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.783947 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.784094 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.784438 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.784443 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.784880 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.785061 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.785067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.786324 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.786327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.787166 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.787175 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.787720 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.787724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.787832 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.788384 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.788401 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.790171 (+ 1770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.792069 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792080 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.792091 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.792447 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.792779 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.792783 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.792784 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.792884 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.793397 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.793406 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.793555 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.794331 (+ 776us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.794536 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":97,"threads_started":1}
I20260811 04:48:48.797247 25750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.124@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
I20260811 04:48:48.808643 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.799140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60012 (local address 127.17.188.125:43361)
0811 04:48:48.799473 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.799477 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.799491 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:48.799537 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.799539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.799576 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.799653 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.800377 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.801125 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.802676 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.802902 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.802980 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.805342 (+ 2362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.805345 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.805347 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.805367 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.806949 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.807450 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.807453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.807455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.807538 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.807840 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.807844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.807846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.808017 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.808120 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.808393 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.808494 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":137,"threads_started":1}
I20260811 04:48:48.808779 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.797790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:60012)
0811 04:48:48.797897 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.797910 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.797980 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.799709 (+ 1729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.799714 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.799927 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.800227 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.800239 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.801236 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.801241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.802460 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.802484 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.803025 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.803032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.803190 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.803644 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.803673 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.805220 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.807070 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.807073 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.807075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.807333 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.807656 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.807659 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.807661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.807751 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.808130 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.808136 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.808237 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.808330 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.808447 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 04:48:48.809481 25750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.124@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
I20260811 04:48:48.817721 25754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.809986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.0.0.1:38966)
0811 04:48:48.810070 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.810084 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.810152 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.810436 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.810438 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.810585 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.810645 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.810650 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.811641 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.811644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.812114 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.812121 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.812639 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.812642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.812713 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.813183 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.813210 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.814593 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.816277 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.816281 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.816283 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.816462 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.816743 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.816747 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.816749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.816829 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.817175 (+ 346us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.817177 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.817255 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.817363 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.817494 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 04:48:48.817721 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.810153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38966 (local address 127.17.188.124:40133)
0811 04:48:48.810268 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.810272 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.810294 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:48:48.810323 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.810324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.810351 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.810425 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.810747 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.811530 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.812221 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.812525 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.812634 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.814730 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.814734 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.814736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.814757 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.816132 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.816572 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.816579 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.816580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.816653 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.816914 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.816919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.816921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.817074 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.817185 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.817421 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.817547 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":50}
I20260811 04:48:48.820637 25750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Bootstrap starting.
I20260811 04:48:48.823401 25750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:48.824342 25750 log.cc:824] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:48.826192 25750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: No bootstrap required, opened a new log
I20260811 04:48:48.830758 25171 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
I20260811 04:48:48.830657 25750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } }
I20260811 04:48:48.830854 25750 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:48.830936 25750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5239d8681e0a45519e3822e184106118, State: Initialized, Role: FOLLOWER
I20260811 04:48:48.831418 25750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } }
I20260811 04:48:48.832249 25757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } } }
I20260811 04:48:48.832424 25757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:48.832907 25750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 04:48:48.838676 25770 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:48:48.838765 25770 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:48:48.842746 25589 master_runner.cc:428] Detected that this master 5239d8681e0a45519e3822e184106118 is joining an existing cluster
I20260811 04:48:48.842813 25589 master_runner.cc:432] Initiating AddMaster RPC to add 127.17.188.124:40133
I20260811 04:48:48.848536 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25034
I20260811 04:48:48.868752 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:42047
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:42863
--webserver_port=40125
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:48:48.883965 25776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.845304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:60016)
0811 04:48:48.845682 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.845696 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.845871 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.846199 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.846202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.846639 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.846931 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.846939 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.848237 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.848240 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.849412 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.849424 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.850741 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.850745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.850971 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.851665 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.851679 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.852139 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.854498 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.854503 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.854507 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.882045 (+ 27538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.882447 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.882450 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.882452 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.882556 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.883193 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.883197 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.883307 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.883503 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.883709 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":22,"thread_start_us":116,"threads_started":1}
I20260811 04:48:48.884563 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.845361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60016 (local address 127.17.188.125:43361)
0811 04:48:48.845501 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.845506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.845787 (+ 281us) server_negotiation.cc:407] Connection header received
0811 04:48:48.845997 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.846000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.846076 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.846164 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.847052 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.847970 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.850249 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.850536 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.850671 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.852273 (+ 1602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.852276 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.852279 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.852303 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.854384 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.882221 (+ 27837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.882226 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.882228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.882338 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.882714 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.882717 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.882719 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.882974 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.883070 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.884243 (+ 1173us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.884394 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:48:48.886852 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.845752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.17.188.126:42863)
0811 04:48:48.845888 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.845893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.847125 (+ 1232us) server_negotiation.cc:407] Connection header received
0811 04:48:48.861230 (+ 14105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.861233 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.861286 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.861385 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.862448 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.863327 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.865249 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.865605 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.865710 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.882728 (+ 17018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.882733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.882735 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.882768 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.884701 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.885418 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.885421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.885423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.885511 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.885837 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.885840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.885842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.886047 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.886126 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.886571 (+ 445us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.886702 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:48:48.887449 25778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.845846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41776)
0811 04:48:48.846996 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.847010 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.847222 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.861469 (+ 14247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.861472 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.861883 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.862299 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.862312 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.863476 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.863482 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.865107 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.865121 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.865722 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.865729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.865925 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.866448 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.866468 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.882528 (+ 16060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.885047 (+ 2519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.885050 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.885052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.885298 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.885645 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.885648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.885650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.885734 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.886194 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.886196 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.886290 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.887047 (+ 757us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.887208 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"thread_start_us":249,"threads_started":1}
I20260811 04:48:48.887669 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.846492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38980 (local address 127.17.188.124:40133)
0811 04:48:48.846635 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.846639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.847289 (+ 650us) server_negotiation.cc:407] Connection header received
0811 04:48:48.847420 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.847423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.847453 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.847492 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.848406 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.850137 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.852203 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.852520 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.852592 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.854299 (+ 1707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.854303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.854308 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.854334 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.856007 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.886090 (+ 30083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.886093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.886095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.886171 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.886577 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.886580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.886581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.886831 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.886912 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.887347 (+ 435us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.887477 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1062,"server-negotiator.queue_time_us":72}
I20260811 04:48:48.888190 25777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.846605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.0.0.1:38980)
0811 04:48:48.847219 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.847231 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.847338 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.847602 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.847605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.848002 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.848256 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.848264 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.850877 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.850880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.852061 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.852075 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.852701 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.852703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.852815 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.853520 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.853531 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.854155 (+ 624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.856146 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.856149 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.856151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.885985 (+ 29834us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.886282 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.886284 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.886286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.886439 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.886984 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.886988 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.887154 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.887810 (+ 656us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.887951 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":152,"threads_started":1}
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423727, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.126@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
I20260811 04:48:48.900856 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.891445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.0.0.1:38992)
0811 04:48:48.891574 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.891590 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.891687 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.891981 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.891985 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.892176 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.892308 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.892315 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.893393 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.893397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.894255 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.894270 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.894869 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.894873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.894982 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.895493 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.895508 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.897120 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.899201 (+ 2081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.899205 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.899207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.899460 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.899763 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.899766 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.899768 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.899871 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.900309 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.900313 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.900424 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.900537 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.900691 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 04:48:48.900949 25753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.891529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38992 (local address 127.17.188.124:40133)
0811 04:48:48.891636 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.891640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.891653 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:48.891814 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.891817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.891867 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.891939 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.892421 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.893269 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.894387 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.894741 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.894850 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.897279 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.897284 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.897287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.897312 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.899065 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.899571 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.899574 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.899576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.899664 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.899980 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.899984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.899986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.900205 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.900301 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.900603 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.900718 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 04:48:48.902931 24964 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.17.188.124:40133: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5239d8681e0a45519e3822e184106118"
member_type: NON_VOTER
last_known_addr {
host: "127.17.188.124"
port: 40133
}
attrs {
promote: true
}
}
dest_uuid: "6f7b5b31db2148f4b318740a4c1aece8"
cas_config_opid_index: 5
I20260811 04:48:48.903535 24964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
I20260811 04:48:48.904556 25576 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5239d8681e0a45519e3822e184106118 (127.17.188.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.906342 25721 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:48.908375 25721 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 04:48:48.909633 25576 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.17.188.124:40133
I20260811 04:48:48.909804 25576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.909907 25576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:48.910287 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.904937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60026 (local address 127.17.188.125:43361)
0811 04:48:48.905144 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.905149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.905295 (+ 146us) server_negotiation.cc:407] Connection header received
0811 04:48:48.905469 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.905472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.905533 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.905649 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:48.906023 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.906809 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.908354 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.909021 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.909132 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.909262 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.909827 (+ 565us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.910120 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260811 04:48:48.910437 25575 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:48.910908 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.904700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:60026)
0811 04:48:48.905234 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.905247 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.905355 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.905798 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.905801 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.905817 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:48.905901 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.905907 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.906995 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.906998 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.908214 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.908224 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.909433 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.909436 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.909529 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.909623 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.910687 (+ 1064us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.910775 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":468}
I20260811 04:48:48.911608 25632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 LEARNER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 04:48:48.912025 25575 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 04:48:48.914399 25632 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5239d8681e0a45519e3822e184106118 (127.17.188.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.914731 25721 raft_consensus.cc:858] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
W20260811 04:48:48.914826 25721 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
I20260811 04:48:48.916143 25721 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.916906 25665 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7b5b31db2148f4b318740a4c1aece8. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.917016 25665 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: LEARNER
I20260811 04:48:48.917104 25665 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.917166 25665 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: LEARNER
I20260811 04:48:48.917445 25589 master.cc:537] Master@127.17.188.124:40133 shutting down...
I20260811 04:48:48.918216 25757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7b5b31db2148f4b318740a4c1aece8. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.918356 25757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 04:48:48.918490 25757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.918581 25757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 04:48:48.918664 25757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: NON_VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: true } } }
I20260811 04:48:48.918746 25757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260811 04:48:48.919518 25575 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: attempting to promote NON_VOTER fe1b5c1c5276477183326ef01027c5a6 to VOTER
I20260811 04:48:48.919940 25575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
I20260811 04:48:48.921249 25780 mvcc.cc:205] Tried to move back new op lower bound from 7317191588031606784 to 7317191587855814656. Current Snapshot: MvccSnapshot[applied={T|T < 7317191587890970624}]
W20260811 04:48:48.923269 24951 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 -> Peer 5239d8681e0a45519e3822e184106118 (127.17.188.124:40133): Couldn't send request to peer 5239d8681e0a45519e3822e184106118. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 04:48:48.923869 25632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 LEARNER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 04:48:48.924345 25576 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 04:48:48.925789 25589 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260811 04:48:48.926034 25589 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260811 04:48:48.926120 25589 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: stopping tablet replica
I20260811 04:48:48.926347 25576 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.927742 25576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.927848 25576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:48.927965 25576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.928035 25576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:48.928594 25632 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.930246 25784 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:48.930418 25784 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:48.940826 25589 master.cc:552] Master@127.17.188.124:40133 shutdown complete.
I20260811 04:48:48.940935 25589 master_runner.cc:305] Clearing existing system tablet
I20260811 04:48:48.941262 25589 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.941378 25589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.942849 25589 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:48.944022 25791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.944290 25589 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:48.944655 25589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:48.944748 25589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "5239d8681e0a45519e3822e184106118"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "9b354e5875a026b7b727792daa24b02d"
server_key_iv: "2235cd57661c796fba130102b96d56f8"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.946733 25589 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:48.949172 25589 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 04:48:48.949337 25589 log.cc:1196] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 04:48:48.949730 25589 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Deleting consensus metadata
I20260811 04:48:48.950022 25589 master_runner.cc:315] Copying system tablet from 127.17.188.126:42863
I20260811 04:48:48.951221 25589 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: tablet copy: Beginning tablet copy session from remote peer at address 127.17.188.126:42863
I20260811 04:48:48.962069 25797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.953414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:41786)
0811 04:48:48.953779 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:48.953794 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:48.953922 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:48.954222 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:48.954225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:48.954454 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:48.954574 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.954581 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.955659 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.955663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.956640 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:48.956649 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.957220 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.957224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:48.957324 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.957942 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:48.957956 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:48.958359 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:48.960360 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.960365 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.960368 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.960619 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.960944 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:48.960947 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:48.960949 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:48.961039 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:48.961493 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:48.961496 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:48.961631 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 04:48:48.961736 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 04:48:48.961871 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":86,"threads_started":1}
I20260811 04:48:48.962072 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:48.953538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.17.188.126:42863)
0811 04:48:48.953726 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:48.953731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:48.953900 (+ 169us) server_negotiation.cc:407] Connection header received
0811 04:48:48.954011 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:48.954031 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:48.954088 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:48.954187 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:48.954707 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.955515 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.956773 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:48.957099 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:48.957210 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:48.958506 (+ 1296us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:48.958509 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:48.958512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:48.958539 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:48.960230 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.960723 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.960726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.960728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.960837 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:48.961165 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:48.961169 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:48.961170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:48.961383 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:48.961482 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:48.961808 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 04:48:48.961926 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 04:48:48.962806 24988 tablet_copy_service.cc:140] P 6f7b5b31db2148f4b318740a4c1aece8: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5239d8681e0a45519e3822e184106118 ({username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:41786)
I20260811 04:48:48.962898 24988 tablet_copy_service.cc:161] P 6f7b5b31db2148f4b318740a4c1aece8: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5239d8681e0a45519e3822e184106118 at {username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:41786: session id = 5239d8681e0a45519e3822e184106118-00000000000000000000000000000000
I20260811 04:48:48.964042 24988 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 04:48:48.965488 25589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 04:48:48.967960 25589 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: tablet copy: Starting download of 0 data blocks...
I20260811 04:48:48.968221 25589 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: tablet copy: Starting download of 1 WAL segments...
I20260811 04:48:48.969794 25589 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 04:48:48.971829 24988 tablet_copy_service.cc:342] P 6f7b5b31db2148f4b318740a4c1aece8: Request end of tablet copy session 5239d8681e0a45519e3822e184106118-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:41786
I20260811 04:48:48.971903 24988 tablet_copy_service.cc:433] P 6f7b5b31db2148f4b318740a4c1aece8: ending tablet copy session 5239d8681e0a45519e3822e184106118-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5239d8681e0a45519e3822e184106118
I20260811 04:48:48.980248 25589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:48.982363 25798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.982743 25801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:48.982851 25799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:48.986600 25589 server_base.cc:1034] running on GCE node
I20260811 04:48:48.986830 25589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:48.987169 25589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:48.988335 25589 hybrid_clock.cc:648] HybridClock initialized: now 1786423728988319 us; error 31 us; skew 500 ppm
Aug 11 04:48:48 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423728, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:48.990150 25589 init.cc:377] Logged in from keytab as oryx/127.17.188.124@KRBTEST.COM (short username oryx)
I20260811 04:48:48.990733 25589 webserver.cc:460] Webserver started at http://127.17.188.124:40085/ using document root <none> and password file <none>
I20260811 04:48:48.990929 25589 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:48.990971 25589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:48.992414 25589 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:48.993541 25810 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:48.993872 25589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:48.993952 25589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "5239d8681e0a45519e3822e184106118"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "9b354e5875a026b7b727792daa24b02d"
server_key_iv: "2235cd57661c796fba130102b96d56f8"
server_key_version: "encryptionkey@0"
I20260811 04:48:48.994035 25589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:49.011194 25589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:49.013944 25589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:49.025192 25589 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.124:40133
I20260811 04:48:49.025898 25589 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
I20260811 04:48:49.028159 25866 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:48:49.029424 25866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Bootstrap starting.
I20260811 04:48:49.029773 25865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.124:40133 every 8 connection(s)
W20260811 04:48:49.036160 25779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:49.036473 25779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:49.036546 25779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 04:48:49.038793 25866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:48:49.039068 25866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Bootstrap complete.
I20260811 04:48:49.039724 25866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
I20260811 04:48:49.039852 25866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5239d8681e0a45519e3822e184106118, State: Initialized, Role: LEARNER
I20260811 04:48:49.039950 25866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } }
I20260811 04:48:49.040342 25872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:49.040472 25866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:49.040490 25872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: LEARNER
W20260811 04:48:49.043267 25779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:49.043339 25779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:49.043442 25779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:49.044292 25884 catalog_manager.cc:1259] Loaded cluster ID: 453be9c7eb924d79bc54fe35978d6831
I20260811 04:48:49.044360 25884 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: loading cluster ID for follower catalog manager: success
I20260811 04:48:49.045928 25884 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: acquiring CA information for follower catalog manager: success
I20260811 04:48:49.046712 25323 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
I20260811 04:48:49.047145 25884 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:48:49.049932 25779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:42047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=40125
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:49.050966 25779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:49.051910 25779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:49.062352 25887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.062340 25889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.062430 25886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:49.062752 25779 server_base.cc:1034] running on GCE node
I20260811 04:48:49.063277 25779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:49.063838 25779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:49.065006 25779 hybrid_clock.cc:648] HybridClock initialized: now 1786423729064962 us; error 54 us; skew 500 ppm
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:49.068574 25779 init.cc:377] Logged in from keytab as oryx/127.17.188.65@KRBTEST.COM (short username oryx)
I20260811 04:48:49.069538 25779 webserver.cc:460] Webserver started at http://127.17.188.65:40125/ using document root <none> and password file <none>
I20260811 04:48:49.070323 25779 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:49.070437 25779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:49.075942 25779 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.001s
I20260811 04:48:49.078434 25896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.079690 25779 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:49.079809 25779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "ad4316a6b21e498ea33b53b7eff85899"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "abedffac6b556854d9e6231e7facc17b"
server_key_iv: "f2b1bb2cff6d56256e49d2dc74eb21f9"
server_key_version: "encryptionkey@0"
I20260811 04:48:49.080466 25779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:49.097932 25779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:49.101248 25779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:49.101490 25779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:49.102263 25779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:49.103204 25779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:49.103286 25779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.103350 25779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:49.103402 25779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.122375 25779 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:42047
I20260811 04:48:49.122538 26021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:42047 every 8 connection(s)
I20260811 04:48:49.123497 25779 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:49.130203 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 25779
I20260811 04:48:49.130425 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25176
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:49.144984 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.127519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:38957 (local address 127.17.188.126:42863)
0811 04:48:49.127700 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.127706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.127725 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:48:49.128303 (+ 578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.128307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.128361 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.128415 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.130227 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.131101 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.133561 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.133948 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.134028 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.140097 (+ 6069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.140103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.140109 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.140142 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.142433 (+ 2291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143177 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.143183 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.143187 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.143272 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143659 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.143664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.143668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.143898 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.143965 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.144627 (+ 662us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.144757 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:48:49.146185 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.125630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:56791 (local address 127.17.188.124:40133)
0811 04:48:49.125928 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.125934 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.127053 (+ 1119us) server_negotiation.cc:407] Connection header received
0811 04:48:49.128276 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.128280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.128342 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.128458 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.130228 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.131552 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.133989 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.134593 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.134743 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.140044 (+ 5301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.140051 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.140058 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.140096 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.142514 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143250 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.143257 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.143262 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.143374 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143804 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.143810 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.143815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.144126 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.144243 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.145711 (+ 1468us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.145903 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":84,"threads_started":1}
I20260811 04:48:49.146566 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.127135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:38957)
0811 04:48:49.127625 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.127640 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.128073 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.128691 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.128694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.129273 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.130028 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.130049 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.131755 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.131760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.133428 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.133441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.134233 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.134238 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.134504 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.135237 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.135260 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.139863 (+ 4603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.142586 (+ 2723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.142594 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.142612 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.143068 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.143376 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143381 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.143385 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.143562 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.144040 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.144047 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.144351 (+ 304us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.145297 (+ 946us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.145456 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":89,"spinlock_wait_cycles":12544,"thread_start_us":151,"threads_started":1}
I20260811 04:48:49.146855 26029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.126115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.17.188.65:56791)
0811 04:48:49.126853 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.126917 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.128057 (+ 1140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.128666 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.128673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.129240 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.130029 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.130050 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.131855 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.131862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.133818 (+ 1956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.133835 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.135232 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.135237 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.135569 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.136366 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.136389 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.139780 (+ 3391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.142671 (+ 2891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.142678 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.142683 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.143106 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.143519 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.143526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.143531 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.143651 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.144301 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.144306 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.144454 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.144608 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.145094 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":89,"spinlock_wait_cycles":896,"thread_start_us":302,"threads_started":1}
I20260811 04:48:49.148248 26023 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:49.148569 26023 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.149173 26023 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:49.150024 26022 heartbeater.cc:347] Connected to a master server at 127.17.188.124:40133
I20260811 04:48:49.150193 26022 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.150411 26022 heartbeater.cc:511] Master 127.17.188.124:40133 requested a full tablet report, sending...
I20260811 04:48:49.150592 24964 ts_manager.cc:194] Re-registered known tserver with Master: ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
I20260811 04:48:49.151237 24964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:38957
I20260811 04:48:49.151564 25829 ts_manager.cc:194] Registered new tserver with Master: ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
I20260811 04:48:49.155682 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:36341
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:42863
--webserver_port=39765
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:48:49.158764 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.126120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.17.188.65:55497)
0811 04:48:49.127252 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.127272 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.128074 (+ 802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.128668 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.128684 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.129279 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.130028 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.130049 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.149153 (+ 19104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.149156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.150114 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.150126 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.152177 (+ 2051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.152180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.152286 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.153403 (+ 1117us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.153415 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.155073 (+ 1658us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.157053 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.157059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.157064 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.157391 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.157781 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.157783 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.157784 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.157866 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.158346 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.158348 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.158421 (+ 73us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.158511 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.158634 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1056,"mutex_wait_us":121,"spinlock_wait_cycles":93696,"thread_start_us":263,"threads_started":1}
I20260811 04:48:49.158972 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.125634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:55497 (local address 127.17.188.125:43361)
0811 04:48:49.125772 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.125777 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.127385 (+ 1608us) server_negotiation.cc:407] Connection header received
0811 04:48:49.128304 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.128307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.128363 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.128415 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.130234 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.131114 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.151618 (+ 20504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.151944 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.152015 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.155257 (+ 3242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.155265 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.155271 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.155304 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.156928 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.157530 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.157536 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.157538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.157674 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.157976 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.157982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.157985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.158247 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.158354 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.158621 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.158750 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:48:49.159727 26024 heartbeater.cc:347] Connected to a master server at 127.17.188.125:43361
I20260811 04:48:49.159827 26024 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.160036 26024 heartbeater.cc:511] Master 127.17.188.125:43361 requested a full tablet report, sending...
I20260811 04:48:49.161096 25621 ts_manager.cc:194] Registered new tserver with Master: ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
I20260811 04:48:49.243217 25469 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
W20260811 04:48:49.267966 26032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:49.268214 26032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:49.268290 26032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:49.272171 26032 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:49.272248 26032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:49.272336 26032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:49.277330 26032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:36341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=39765
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:49.278345 26032 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:49.279340 26032 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:49.289716 26038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.289804 26040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.289716 26037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:49.290122 26032 server_base.cc:1034] running on GCE node
I20260811 04:48:49.290536 26032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:49.291180 26032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:49.292311 26032 hybrid_clock.cc:648] HybridClock initialized: now 1786423729292298 us; error 25 us; skew 500 ppm
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:49.295140 26032 init.cc:377] Logged in from keytab as oryx/127.17.188.66@KRBTEST.COM (short username oryx)
I20260811 04:48:49.295950 26032 webserver.cc:460] Webserver started at http://127.17.188.66:39765/ using document root <none> and password file <none>
I20260811 04:48:49.296465 26032 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:49.296540 26032 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:49.300834 26032 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:49.302914 26050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.304157 26032 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:49.304250 26032 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "4a901967c9be431da5e830a1da689906"
format_stamp: "Formatted at 2026-08-11 04:48:47 on dist-test-slave-njxd"
server_key: "c503e945dc74c896b4606bcbf8478652"
server_key_iv: "652606ac63cf861e48f92a9caa828723"
server_key_version: "encryptionkey@0"
I20260811 04:48:49.304790 26032 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:49.335456 26032 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:49.338550 26032 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:49.338761 26032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:49.339340 26032 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:49.340320 26032 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:49.340369 26032 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.340436 26032 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:49.340466 26032 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.350433 26032 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:36341
I20260811 04:48:49.350463 26173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:36341 every 8 connection(s)
I20260811 04:48:49.351650 26032 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:49.353484 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26032
I20260811 04:48:49.353675 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25329
I20260811 04:48:49.355356 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.350240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.0.0.1:38998)
0811 04:48:49.350464 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.350481 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.350580 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.350886 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.350890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.350909 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.351023 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.351030 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.351850 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.351854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.352925 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.352938 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.354914 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.354918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.355010 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.355036 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.355131 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.355219 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134}
I20260811 04:48:49.355453 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.350424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38998 (local address 127.17.188.124:40133)
0811 04:48:49.350567 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.350572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.350592 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:48:49.350671 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.350674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.350733 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.350858 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.351179 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.351728 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.353074 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.353826 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.353964 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.354142 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.355160 (+ 1018us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.355275 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 04:48:49.359745 25839 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 04:48:49.360051 25872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f7b5b31db2148f4b318740a4c1aece8. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:49.360224 25872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: LEARNER
I20260811 04:48:49.365954 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:41091
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:42863
--webserver_port=45067
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:37345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
I20260811 04:48:49.372900 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.359087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44057 (local address 127.17.188.125:43361)
0811 04:48:49.359210 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.359215 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.359228 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:49.359270 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.359273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.359330 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.359409 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.360984 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.361754 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363236 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.363586 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363658 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.367984 (+ 4326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.367990 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.367994 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.368028 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.370299 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.370963 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.370968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.370973 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.371071 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371501 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.371505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.371506 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.371793 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.371864 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.372611 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.372737 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 04:48:49.372905 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.353866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:57661 (local address 127.17.188.124:40133)
0811 04:48:49.355622 (+ 1756us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.355628 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.357231 (+ 1603us) server_negotiation.cc:407] Connection header received
0811 04:48:49.357920 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.357926 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.357995 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.358061 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.360504 (+ 2443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.361227 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363235 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.363586 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363665 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.368477 (+ 4812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.368481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.368484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.368509 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.370390 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371284 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.371287 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.371289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.371369 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371716 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.371738 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.371739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.371955 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.372032 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.372620 (+ 588us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.372736 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1688,"thread_start_us":84,"threads_started":1}
I20260811 04:48:49.373015 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.357734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:51103 (local address 127.17.188.126:42863)
0811 04:48:49.357851 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.357856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.358454 (+ 598us) server_negotiation.cc:407] Connection header received
0811 04:48:49.358561 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.358567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.358619 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.358721 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.361083 (+ 2362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.362010 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363442 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.363875 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363965 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.368477 (+ 4512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.368481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.368484 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.368509 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.370633 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371279 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.371283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.371285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.371380 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371793 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.371798 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.371802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.372060 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.372146 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.372626 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.372782 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:48:49.374795 26179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.354215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.17.188.66:44057)
0811 04:48:49.356454 (+ 2239us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.356506 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.357684 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.360506 (+ 2822us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.360511 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.360708 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.360855 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.360865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.361901 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.361904 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.363096 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.363107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.363856 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.364160 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.365008 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.365041 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.367770 (+ 2729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.370441 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.370450 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.370469 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.370846 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.371204 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371210 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.371215 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.371388 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.371949 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.371955 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.372303 (+ 348us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.373210 (+ 907us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.373611 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2021,"mutex_wait_us":240,"spinlock_wait_cycles":16256,"thread_start_us":466,"threads_started":1}
I20260811 04:48:49.375134 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.357194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:51103)
0811 04:48:49.358359 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.358370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.358486 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.358843 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.358849 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.359174 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.360971 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.360980 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.362169 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.362176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.363279 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.363294 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.364158 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.364165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.364313 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.365070 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.365089 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.368323 (+ 3234us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.370784 (+ 2461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.370789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.370794 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.371148 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.371513 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371519 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.371524 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.371624 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.372231 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.372236 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.372360 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.373225 (+ 865us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.373724 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1114,"mutex_wait_us":181,"spinlock_wait_cycles":15488,"thread_start_us":278,"threads_started":1}
I20260811 04:48:49.374809 26180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.356711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.17.188.66:57661)
0811 04:48:49.357130 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.357149 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.357631 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.358489 (+ 858us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.358502 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.360165 (+ 1663us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.360346 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.360370 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.361399 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.361402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.363096 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.363107 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.363856 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.363860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.364160 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.365173 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.365192 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.368323 (+ 3131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.370498 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.370500 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.370503 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.371173 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.371484 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.371487 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.371489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.371572 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.372083 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.372086 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.372303 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.373798 (+ 1495us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.373940 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":147,"spinlock_wait_cycles":17024,"thread_start_us":200,"threads_started":1}
I20260811 04:48:49.376394 26175 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:49.376391 26174 heartbeater.cc:347] Connected to a master server at 127.17.188.124:40133
I20260811 04:48:49.376654 26174 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.376643 26175 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.376924 26176 heartbeater.cc:347] Connected to a master server at 127.17.188.125:43361
I20260811 04:48:49.377027 26176 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.377298 26176 heartbeater.cc:511] Master 127.17.188.125:43361 requested a full tablet report, sending...
I20260811 04:48:49.377313 26174 heartbeater.cc:511] Master 127.17.188.124:40133 requested a full tablet report, sending...
I20260811 04:48:49.377298 26175 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:49.378592 24964 ts_manager.cc:194] Re-registered known tserver with Master: 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:49.378657 25829 ts_manager.cc:194] Registered new tserver with Master: 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:49.378679 25621 ts_manager.cc:194] Registered new tserver with Master: 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:49.379499 24964 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:51103
W20260811 04:48:49.483489 26182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:49.483842 26182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:49.483909 26182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:49.489969 26182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:49.490041 26182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:49.490127 26182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:49.495977 26182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:37345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:41091
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=45067
--tserver_master_addrs=127.17.188.126:42863,127.17.188.125:43361,127.17.188.124:40133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26182
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:49.497028 26182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:49.498083 26182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:49.508062 26188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.508142 26190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:49.508087 26192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:49.508304 26182 server_base.cc:1034] running on GCE node
I20260811 04:48:49.508709 26182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:49.509351 26182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:49.510577 26182 hybrid_clock.cc:648] HybridClock initialized: now 1786423729510546 us; error 43 us; skew 500 ppm
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:49.513531 26182 init.cc:377] Logged in from keytab as oryx/127.17.188.67@KRBTEST.COM (short username oryx)
I20260811 04:48:49.514477 26182 webserver.cc:460] Webserver started at http://127.17.188.67:45067/ using document root <none> and password file <none>
I20260811 04:48:49.515071 26182 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:49.515189 26182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:49.519071 26182 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:48:49.521056 26199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.522336 26182 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:49.522481 26182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "acb001cea077401bbf79dc022f508749"
format_stamp: "Formatted at 2026-08-11 04:48:48 on dist-test-slave-njxd"
server_key: "64631e95f1ca8960bd6ffd454168363d"
server_key_iv: "d6aa3ab84e138f7514358d1761769861"
server_key_version: "encryptionkey@0"
I20260811 04:48:49.523012 26182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:49.538177 26182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:49.542027 26182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:49.542178 26182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:49.542666 26182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:49.543514 26182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:49.543560 26182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.543597 26182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:49.543614 26182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:49.552210 26182 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:41091
I20260811 04:48:49.552279 26321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:41091 every 8 connection(s)
I20260811 04:48:49.553174 26182 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:49.553993 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26182
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.125@KRBTEST.COM
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
Aug 11 04:48:49 dist-test-slave-njxd krb5kdc[24918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423729, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.124@KRBTEST.COM
I20260811 04:48:49.570823 25009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.557109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.17.188.126:42863)
0811 04:48:49.557226 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.557231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.557685 (+ 454us) server_negotiation.cc:407] Connection header received
0811 04:48:49.557900 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.557904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.557958 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.558013 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.559118 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.559919 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.561140 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.561456 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.561526 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.565719 (+ 4193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.565723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.565725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.565770 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.567869 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.568454 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.568457 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.568459 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.568544 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.568886 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.568890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.568892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.569131 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.569237 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.570476 (+ 1239us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.570613 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 04:48:49.571501 26178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.556868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39006 (local address 127.17.188.124:40133)
0811 04:48:49.556975 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.556979 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.558081 (+ 1102us) server_negotiation.cc:407] Connection header received
0811 04:48:49.558231 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.558234 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.558272 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.558358 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.562285 (+ 3927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.563116 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.564514 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.564907 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.564978 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.566727 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.566731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.566734 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.566758 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.569249 (+ 2491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.569784 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.569790 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.569795 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.569892 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.570260 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.570264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.570265 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.570480 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.570609 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.570957 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.571251 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:48:49.575893 25755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.555434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:51451 (local address 127.17.188.125:43361)
0811 04:48:49.555688 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.555692 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.558847 (+ 3155us) server_negotiation.cc:407] Connection header received
0811 04:48:49.559041 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.559045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.559102 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.559155 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.559757 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.560489 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.564522 (+ 4033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.564894 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.564980 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.569678 (+ 4698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.569685 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.569689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.569719 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.573151 (+ 3432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574218 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.574221 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.574223 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.574308 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574745 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.574748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.574750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.574942 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.575018 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.575637 (+ 619us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.575750 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 04:48:49.575906 26336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.557147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:36461 (local address 127.17.188.126:42863)
0811 04:48:49.557357 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.557362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.562153 (+ 4791us) server_negotiation.cc:407] Connection header received
0811 04:48:49.562252 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.562257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.562302 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.562381 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.564367 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.565121 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.566724 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.567118 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.567190 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.572158 (+ 4968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.572162 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.572168 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.572197 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.574074 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574519 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.574523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.574524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.574626 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574927 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.574930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.574932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.575109 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.575217 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.575624 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.575746 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":79,"threads_started":1}
I20260811 04:48:49.576906 26331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.556741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:36461)
0811 04:48:49.562023 (+ 5282us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.562040 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.562169 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.563611 (+ 1442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.563615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.563977 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.564230 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.564239 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.565275 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.565279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.566572 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.566585 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.567529 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.567536 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.567692 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.568195 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.568211 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.572011 (+ 3800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.574194 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.574199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.574413 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.574724 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574729 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.574730 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.574819 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.575207 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.575211 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.575382 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.575573 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.575892 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5203,"mutex_wait_us":1,"thread_start_us":91,"threads_started":1}
I20260811 04:48:49.577232 26333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.555702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.17.188.67:51451)
0811 04:48:49.558757 (+ 3055us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.558772 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.558925 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.559291 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.559293 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.559498 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.559625 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.559631 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.560637 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.560640 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.562521 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.562531 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.565148 (+ 2617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.565153 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.565328 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.566037 (+ 709us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.566058 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.568925 (+ 2867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.573291 (+ 4366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.573299 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.573317 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.573732 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.574418 (+ 686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574420 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.574422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.574622 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.575083 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.575090 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.575385 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.576247 (+ 862us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.576384 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2951,"mutex_wait_us":576,"spinlock_wait_cycles":14848,"thread_start_us":169,"threads_started":1}
I20260811 04:48:49.578410 26324 heartbeater.cc:347] Connected to a master server at 127.17.188.125:43361
I20260811 04:48:49.574682 24964 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41802:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 04:48:49.578681 26324 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.579169 26324 heartbeater.cc:511] Master 127.17.188.125:43361 requested a full tablet report, sending...
W20260811 04:48:49.579597 24964 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:49.579746 26323 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42863
I20260811 04:48:49.579833 26323 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.580013 26323 heartbeater.cc:511] Master 127.17.188.126:42863 requested a full tablet report, sending...
I20260811 04:48:49.580528 25621 ts_manager.cc:194] Registered new tserver with Master: acb001cea077401bbf79dc022f508749 (127.17.188.67:41091)
I20260811 04:48:49.580731 24963 ts_manager.cc:194] Re-registered known tserver with Master: acb001cea077401bbf79dc022f508749 (127.17.188.67:41091)
I20260811 04:48:49.581422 24963 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:36461
I20260811 04:48:49.582630 25786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: NON_VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: true } } }
I20260811 04:48:49.582769 25786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:49.584286 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.555703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.17.188.67:41003)
0811 04:48:49.556231 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.556283 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.557593 (+ 1310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.558141 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.558150 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.558711 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:49.559416 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.559436 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.560553 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.560557 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.562018 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.562624 (+ 606us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.563656 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.563660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.564053 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.568083 (+ 4030us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:49.568102 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:49.570758 (+ 2656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:49.574197 (+ 3439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.574203 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.574205 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.581675 (+ 7470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.582528 (+ 853us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:49.582531 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:49.582533 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:49.582625 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:49.583622 (+ 997us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:49.583626 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:49.583795 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.583905 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.584055 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":42,"spinlock_wait_cycles":3328,"thread_start_us":150,"threads_started":1}
I20260811 04:48:49.584290 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.555278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:41003 (local address 127.17.188.124:40133)
0811 04:48:49.555586 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.555591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.556385 (+ 794us) server_negotiation.cc:407] Connection header received
0811 04:48:49.557805 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.557807 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.557857 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.557959 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.559576 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.560382 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.562731 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.563047 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.563138 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.570915 (+ 7777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.570919 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.570922 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.570942 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.574060 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.582245 (+ 8185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.582249 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.582251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.582376 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.582979 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.582983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.582984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.583226 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.583327 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.584016 (+ 689us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.584147 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"spinlock_wait_cycles":1792}
I20260811 04:48:49.584992 26322 heartbeater.cc:347] Connected to a master server at 127.17.188.124:40133
I20260811 04:48:49.585088 26322 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:49.585243 26340 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: attempting to promote NON_VOTER 5239d8681e0a45519e3822e184106118 to VOTER
I20260811 04:48:49.585263 26322 heartbeater.cc:511] Master 127.17.188.124:40133 requested a full tablet report, sending...
I20260811 04:48:49.585675 26338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.557354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60038 (local address 127.17.188.125:43361)
0811 04:48:49.557659 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.557667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.559223 (+ 1556us) server_negotiation.cc:407] Connection header received
0811 04:48:49.559273 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.559277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.559324 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.559406 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.560319 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.561088 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.562308 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.562700 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.562791 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.564470 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.564476 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.564481 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.564513 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.574083 (+ 9570us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.582752 (+ 8669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.582759 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.582760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.582850 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.584518 (+ 1668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.584521 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.584524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.584756 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.584910 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.585354 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.585484 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
I20260811 04:48:49.585691 26340 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } }
I20260811 04:48:49.587205 25632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 04:48:49.587332 25829 ts_manager.cc:194] Registered new tserver with Master: acb001cea077401bbf79dc022f508749 (127.17.188.67:41091)
I20260811 04:48:49.587649 25839 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 LEARNER]: Refusing update from remote peer 6f7b5b31db2148f4b318740a4c1aece8: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 04:48:49.587630 25786 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 04:48:49.588008 25786 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260811 04:48:49.589608 26345 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5239d8681e0a45519e3822e184106118 (127.17.188.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.589951 25632 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5239d8681e0a45519e3822e184106118 (127.17.188.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.590087 25839 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5239d8681e0a45519e3822e184106118 (127.17.188.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.591558 26345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.591697 26345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:49.591849 26345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.591980 26345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:49.592219 26345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.592202 25872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.592324 25872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:49.592324 26345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:49.595203 26349 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6f7b5b31db2148f4b318740a4c1aece8" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:49.595329 26349 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:49.603669 26354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.598805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42047 (local address 127.0.0.1:52626)
0811 04:48:49.599075 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.599088 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.599174 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.599744 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.599746 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.599761 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.599831 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.599835 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.601196 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.601199 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.602286 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.602293 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.603146 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.603149 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.603311 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.603344 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.603428 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.603501 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":90,"threads_started":1}
I20260811 04:48:49.603931 26355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.598933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52626 (local address 127.17.188.65:42047)
0811 04:48:49.599221 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.599237 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.599259 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:48:49.599339 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.599346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.599603 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.599753 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.599905 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.601067 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.602399 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.603012 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.603146 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.603310 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.603472 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.603566 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":95,"threads_started":1}
I20260811 04:48:49.604074 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.597646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55124 (local address 127.17.188.67:41091)
0811 04:48:49.598258 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.598271 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.598294 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:48:49.598415 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.598424 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.598666 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.599199 (+ 533us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.599317 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.600614 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.602178 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.603011 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.603132 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.603268 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.603790 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.603873 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":104,"threads_started":1}
I20260811 04:48:49.603698 25573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.597254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41091 (local address 127.0.0.1:55124)
0811 04:48:49.597361 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.597377 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.597460 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.598900 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.598906 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.598929 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.599036 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.599044 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.600743 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.600746 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.602057 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.602068 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.603330 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.603333 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.603418 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.603439 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.603508 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.603568 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 04:48:49.606438 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.598149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48214 (local address 127.17.188.66:36341)
0811 04:48:49.600987 (+ 2838us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.601023 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.601044 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:48:49.601123 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.601130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.601296 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.601477 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.601686 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.602787 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.604258 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.605236 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.605397 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.605594 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.606140 (+ 546us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.606227 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2742,"thread_start_us":95,"threads_started":1}
I20260811 04:48:49.606773 26352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.597986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:36341 (local address 127.0.0.1:48214)
0811 04:48:49.598263 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.598278 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.598423 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.601458 (+ 3035us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.601461 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.601480 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.601566 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.601599 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.602940 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.602946 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.604073 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.604086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.605677 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.605681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.605842 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.605866 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.605987 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.606635 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":121,"threads_started":1}
I20260811 04:48:49.607687 26253 tablet_service.cc:1467] Processing CreateTablet for tablet bc947b35455f44dda4d336924127a24c (DEFAULT_TABLE table=test-table [id=8d14bf7551e2410485ead3bc7567162f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:49.607592 25949 tablet_service.cc:1467] Processing CreateTablet for tablet bc947b35455f44dda4d336924127a24c (DEFAULT_TABLE table=test-table [id=8d14bf7551e2410485ead3bc7567162f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:49.608848 26253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc947b35455f44dda4d336924127a24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:49.608862 25949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc947b35455f44dda4d336924127a24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:49.609678 26104 tablet_service.cc:1467] Processing CreateTablet for tablet bc947b35455f44dda4d336924127a24c (DEFAULT_TABLE table=test-table [id=8d14bf7551e2410485ead3bc7567162f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:49.610532 26104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc947b35455f44dda4d336924127a24c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:49.616425 26356 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Bootstrap starting.
I20260811 04:48:49.619311 26356 tablet_bootstrap.cc:654] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:49.620483 26356 log.cc:824] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:49.621219 26359 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Bootstrap starting.
I20260811 04:48:49.621310 26358 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Bootstrap starting.
I20260811 04:48:49.623461 26356 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: No bootstrap required, opened a new log
I20260811 04:48:49.623668 26356 ts_tablet_manager.cc:1397] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260811 04:48:49.624207 26358 tablet_bootstrap.cc:654] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:49.625403 26358 log.cc:824] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:49.626579 26359 tablet_bootstrap.cc:654] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:49.629117 26359 log.cc:824] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:49.629756 26358 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: No bootstrap required, opened a new log
I20260811 04:48:49.629978 26358 ts_tablet_manager.cc:1397] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 04:48:49.630486 26356 raft_consensus.cc:348] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.630734 26356 raft_consensus.cc:374] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:49.630792 26356 raft_consensus.cc:729] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acb001cea077401bbf79dc022f508749, State: Initialized, Role: FOLLOWER
I20260811 04:48:49.631224 26356 consensus_queue.cc:260] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.632301 26356 ts_tablet_manager.cc:1428] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Time spent starting tablet: real 0.009s user 0.005s sys 0.005s
I20260811 04:48:49.632475 26323 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
I20260811 04:48:49.636943 26359 tablet_bootstrap.cc:492] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: No bootstrap required, opened a new log
I20260811 04:48:49.637137 26359 ts_tablet_manager.cc:1397] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.000s
I20260811 04:48:49.641185 26358 raft_consensus.cc:348] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.641520 26358 raft_consensus.cc:374] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:49.641614 26358 raft_consensus.cc:729] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad4316a6b21e498ea33b53b7eff85899, State: Initialized, Role: FOLLOWER
I20260811 04:48:49.642230 26358 consensus_queue.cc:260] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.643071 26023 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
I20260811 04:48:49.643517 26358 ts_tablet_manager.cc:1428] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Time spent starting tablet: real 0.013s user 0.000s sys 0.009s
I20260811 04:48:49.644037 26359 raft_consensus.cc:348] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.644282 26359 raft_consensus.cc:374] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:49.644351 26359 raft_consensus.cc:729] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a901967c9be431da5e830a1da689906, State: Initialized, Role: FOLLOWER
I20260811 04:48:49.644889 26359 consensus_queue.cc:260] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.645232 26364 raft_consensus.cc:482] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:49.645428 26364 raft_consensus.cc:504] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.646236 26359 ts_tablet_manager.cc:1428] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Time spent starting tablet: real 0.009s user 0.002s sys 0.007s
I20260811 04:48:49.646440 26175 heartbeater.cc:503] Master 127.17.188.126:42863 was elected leader, sending a full tablet report...
I20260811 04:48:49.646754 26364 leader_election.cc:288] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acb001cea077401bbf79dc022f508749 (127.17.188.67:41091), 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:49.652325 26030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.647014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41091 (local address 127.17.188.65:43265)
0811 04:48:49.647209 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.647228 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.647345 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.648305 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.648308 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.648325 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.648527 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.648538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.649612 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.649616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.650850 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.650862 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.651805 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.651808 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.651945 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.651967 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.652079 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.652173 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 04:48:49.652318 26351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.647681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:43265 (local address 127.17.188.67:41091)
0811 04:48:49.648113 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.648117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.648128 (+ 11us) server_negotiation.cc:407] Connection header received
0811 04:48:49.648167 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.648169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.648204 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.648295 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.648672 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.649468 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.651015 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.651684 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.651805 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.651859 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.652121 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.652196 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353}
I20260811 04:48:49.652451 26031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.647398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:36341 (local address 127.17.188.65:41819)
0811 04:48:49.647871 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:49.647886 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:49.647958 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:49.648896 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:49.648900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:49.648915 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:49.649091 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.649098 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.650056 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.650059 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.651202 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:49.651211 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.652040 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.652046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:49.652191 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.652211 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 04:48:49.652283 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 04:48:49.652344 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400}
I20260811 04:48:49.652887 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.648479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:41819 (local address 127.17.188.66:36341)
0811 04:48:49.648634 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.648639 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.648652 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:49.648691 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.648694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.648733 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.648798 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:49.649219 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.649930 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.651326 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.651916 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.652017 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.652079 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.652664 (+ 585us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.652763 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:49.653110 26274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc947b35455f44dda4d336924127a24c" candidate_uuid: "ad4316a6b21e498ea33b53b7eff85899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acb001cea077401bbf79dc022f508749" is_pre_election: true
I20260811 04:48:49.653384 26274 raft_consensus.cc:2454] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad4316a6b21e498ea33b53b7eff85899 in term 0.
I20260811 04:48:49.653635 26126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc947b35455f44dda4d336924127a24c" candidate_uuid: "ad4316a6b21e498ea33b53b7eff85899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a901967c9be431da5e830a1da689906" is_pre_election: true
I20260811 04:48:49.653918 25898 leader_election.cc:302] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acb001cea077401bbf79dc022f508749, ad4316a6b21e498ea33b53b7eff85899; no voters:
I20260811 04:48:49.653944 26126 raft_consensus.cc:2454] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad4316a6b21e498ea33b53b7eff85899 in term 0.
I20260811 04:48:49.654277 26364 raft_consensus.cc:2781] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:49.654371 26364 raft_consensus.cc:482] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:49.654428 26364 raft_consensus.cc:3037] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:49.655756 26364 raft_consensus.cc:504] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.656101 26364 leader_election.cc:288] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [CANDIDATE]: Term 1 election: Requested vote from peers acb001cea077401bbf79dc022f508749 (127.17.188.67:41091), 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341)
I20260811 04:48:49.656456 26274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc947b35455f44dda4d336924127a24c" candidate_uuid: "ad4316a6b21e498ea33b53b7eff85899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acb001cea077401bbf79dc022f508749"
I20260811 04:48:49.656450 26126 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc947b35455f44dda4d336924127a24c" candidate_uuid: "ad4316a6b21e498ea33b53b7eff85899" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a901967c9be431da5e830a1da689906"
I20260811 04:48:49.656591 26126 raft_consensus.cc:3037] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:49.656572 26274 raft_consensus.cc:3037] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:49.658279 26274 raft_consensus.cc:2454] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad4316a6b21e498ea33b53b7eff85899 in term 1.
I20260811 04:48:49.658576 25898 leader_election.cc:302] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acb001cea077401bbf79dc022f508749, ad4316a6b21e498ea33b53b7eff85899; no voters:
I20260811 04:48:49.658603 26126 raft_consensus.cc:2454] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad4316a6b21e498ea33b53b7eff85899 in term 1.
I20260811 04:48:49.658756 26364 raft_consensus.cc:2781] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:49.658982 26364 raft_consensus.cc:686] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 1 LEADER]: Becoming Leader. State: Replica: ad4316a6b21e498ea33b53b7eff85899, State: Running, Role: LEADER
I20260811 04:48:49.659328 26364 consensus_queue.cc:237] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } }
I20260811 04:48:49.662765 24963 catalog_manager.cc:5495] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "ad4316a6b21e498ea33b53b7eff85899" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:49.676342 26355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.672497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52638 (local address 127.17.188.65:42047)
0811 04:48:49.672621 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.672625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.672639 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:49.672780 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.672784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.672837 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.672948 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:49.673321 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.673922 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.674823 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.675047 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.675164 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.675543 (+ 379us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:49.675941 (+ 398us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:49.676077 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.676147 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.676199 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 04:48:49.682610 26126 raft_consensus.cc:1261] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Refusing update from remote peer ad4316a6b21e498ea33b53b7eff85899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:49.682626 26274 raft_consensus.cc:1261] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Refusing update from remote peer ad4316a6b21e498ea33b53b7eff85899: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:49.683427 26364 consensus_queue.cc:1035] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:49.683733 26366 consensus_queue.cc:1035] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:49.692322 26369 mvcc.cc:205] Tried to move back new op lower bound from 7317191596771889152 to 7317191596687613952. Current Snapshot: MvccSnapshot[applied={T|T < 7317191596771889152}]
I20260811 04:48:49.702484 24964 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:49.702677 24964 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41802:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:49.706904 24964 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6f7b5b31db2148f4b318740a4c1aece8: Sending DeleteTablet for 3 replicas of tablet bc947b35455f44dda4d336924127a24c
I20260811 04:48:49.707971 26104 tablet_service.cc:1514] Processing DeleteTablet for tablet bc947b35455f44dda4d336924127a24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:49 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:48214
I20260811 04:48:49.708853 26378 tablet_replica.cc:330] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: stopping tablet replica
I20260811 04:48:49.709240 26378 raft_consensus.cc:2229] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:49.709409 25949 tablet_service.cc:1514] Processing DeleteTablet for tablet bc947b35455f44dda4d336924127a24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:49 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:52626
I20260811 04:48:49.709614 26378 raft_consensus.cc:2258] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:49.710589 26253 tablet_service.cc:1514] Processing DeleteTablet for tablet bc947b35455f44dda4d336924127a24c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:49 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:55124
I20260811 04:48:49.710788 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 24931
I20260811 04:48:49.714191 26378 ts_tablet_manager.cc:1905] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:49.715488 26380 tablet_replica.cc:330] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: stopping tablet replica
I20260811 04:48:49.715924 26380 raft_consensus.cc:2229] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:49.716356 26380 raft_consensus.cc:2258] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:49.716892 26381 tablet_replica.cc:330] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: stopping tablet replica
I20260811 04:48:49.717314 26381 raft_consensus.cc:2229] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:49.717759 26381 raft_consensus.cc:2258] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:49.718346 26378 ts_tablet_manager.cc:1918] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:49.718451 26378 log.cc:1196] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/bc947b35455f44dda4d336924127a24c
I20260811 04:48:49.719200 26378 ts_tablet_manager.cc:1939] T bc947b35455f44dda4d336924127a24c P 4a901967c9be431da5e830a1da689906: Deleting consensus metadata
I20260811 04:48:49.721504 26380 ts_tablet_manager.cc:1905] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:49.725282 26380 ts_tablet_manager.cc:1918] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:49.725394 26380 log.cc:1196] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/bc947b35455f44dda4d336924127a24c
I20260811 04:48:49.725786 26380 ts_tablet_manager.cc:1939] T bc947b35455f44dda4d336924127a24c P ad4316a6b21e498ea33b53b7eff85899: Deleting consensus metadata
I20260811 04:48:49.726405 26381 ts_tablet_manager.cc:1905] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 04:48:49.726907 25897 connection.cc:441] server connection from 127.0.0.1:52626 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:52626 (request call id 1) could send its response
I20260811 04:48:49.729118 26381 ts_tablet_manager.cc:1918] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 04:48:49.729399 26054 connection.cc:535] server connection from 127.0.0.1:48214 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:48:49.729640 26338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.709364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60048 (local address 127.17.188.125:43361)
0811 04:48:49.709569 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.709599 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.718454 (+ 8855us) server_negotiation.cc:407] Connection header received
0811 04:48:49.718928 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.718932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.718991 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.719046 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.720557 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.721398 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.722705 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.723062 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.723156 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.725817 (+ 2661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.725821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.725824 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.725853 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.727641 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.728200 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.728205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.728207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.728298 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.728629 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.728632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.728634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.728864 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.729011 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.729278 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.729439 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
W20260811 04:48:49.731190 25813 connection.cc:535] server connection from 127.0.0.1:38998 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:48:49.731484 26381 log.cc:1196] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/bc947b35455f44dda4d336924127a24c
I20260811 04:48:49.732754 26381 ts_tablet_manager.cc:1939] T bc947b35455f44dda4d336924127a24c P acb001cea077401bbf79dc022f508749: Deleting consensus metadata
W20260811 04:48:49.734170 26202 connection.cc:441] server connection from 127.0.0.1:55124 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55124 (request call id 1) could send its response
I20260811 04:48:49.738718 26026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.709455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39012 (local address 127.17.188.124:40133)
0811 04:48:49.709693 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.709697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.729673 (+ 19976us) server_negotiation.cc:407] Connection header received
0811 04:48:49.729848 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.729851 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.729909 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.729996 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.730940 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.731735 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.732918 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.733228 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.733302 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.735054 (+ 1752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.735060 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.735066 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.735098 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.736846 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.737354 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.737357 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.737359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.737443 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.737787 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.737790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.737804 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.737985 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.738079 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.738422 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.738545 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260811 04:48:49.743650 26338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.734415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60058 (local address 127.17.188.125:43361)
0811 04:48:49.734520 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.734524 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.734972 (+ 448us) server_negotiation.cc:407] Connection header received
0811 04:48:49.735146 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.735149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.735189 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.735235 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.736014 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.736770 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.737931 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.738255 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.738340 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.740189 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.740192 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.740195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.740219 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.741935 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.742443 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.742446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.742448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.742527 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.742841 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.742844 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.742845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.743027 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.743148 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.743406 (+ 258us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.743508 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:48:49.745242 26178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:49.735390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39014 (local address 127.17.188.124:40133)
0811 04:48:49.735519 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:49.735524 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:49.736335 (+ 811us) server_negotiation.cc:407] Connection header received
0811 04:48:49.736497 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:49.736501 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:49.736549 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:49.736602 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:49.737554 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.738339 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.739797 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:49.740141 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:49.740215 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:49.741943 (+ 1728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:49.741947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:49.741950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:49.741973 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:49.743697 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.744133 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.744148 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.744149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.744247 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:49.744567 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:49.744570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:49.744572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:49.744717 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:49.744806 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:49.745025 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 04:48:49.745116 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:48:50.696782 26389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:50.696260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:36273)
0811 04:48:50.696526 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:50.696616 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":81,"threads_started":1}
W20260811 04:48:50.697247 26175 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:42863 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:50.703310 26390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:50.702854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:33583)
0811 04:48:50.703137 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:50.703220 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":76,"threads_started":1}
I20260811 04:48:50.703310 26391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:50.702879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:58627)
0811 04:48:50.703145 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:50.703224 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":91,"threads_started":1}
W20260811 04:48:50.703671 26023 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:42863 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
W20260811 04:48:50.703830 26323 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:42863 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.207185 26392 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f7b5b31db2148f4b318740a4c1aece8)
I20260811 04:48:51.207406 26392 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } }
I20260811 04:48:51.208415 26392 leader_election.cc:288] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863), 5239d8681e0a45519e3822e184106118 (127.17.188.124:40133)
I20260811 04:48:51.208977 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.208526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42332)
0811 04:48:51.208790 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.208867 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":98,"threads_started":1}
W20260811 04:48:51.209174 25606 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.210121 26394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.209887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42338)
0811 04:48:51.210000 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.210055 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 04:48:51.210260 25606 leader_election.cc:334] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863): Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.212673 26393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.208898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:40133 (local address 127.0.0.1:39022)
0811 04:48:51.209145 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.209157 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.209247 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.209670 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.209673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.209701 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.209835 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.209842 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.210847 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.210850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.211686 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.211695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.212345 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.212348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.212423 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.212444 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.212509 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.212588 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":51,"threads_started":1}
I20260811 04:48:51.212690 26396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.209113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39022 (local address 127.17.188.124:40133)
0811 04:48:51.209352 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.209361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.209378 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:48:51.209455 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.209457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.209508 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.209645 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.209968 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.210681 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.211799 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.212212 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.212303 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.212343 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.212533 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.212596 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":68,"threads_started":1}
I20260811 04:48:51.213292 25839 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fe1b5c1c5276477183326ef01027c5a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5239d8681e0a45519e3822e184106118" is_pre_election: true
I20260811 04:48:51.213862 25606 leader_election.cc:302] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fe1b5c1c5276477183326ef01027c5a6; no voters: 5239d8681e0a45519e3822e184106118, 6f7b5b31db2148f4b318740a4c1aece8
I20260811 04:48:51.214066 26392 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:48:51.214704 26399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f7b5b31db2148f4b318740a4c1aece8)
I20260811 04:48:51.214861 26399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } }
I20260811 04:48:51.215651 26399 leader_election.cc:288] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863), fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125:43361)
I20260811 04:48:51.216147 26400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.215713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42346)
0811 04:48:51.215950 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.216033 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":85,"threads_started":1}
W20260811 04:48:51.216351 25815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.217157 26400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.216954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42358)
0811 04:48:51.217057 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.217104 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 04:48:51.217265 25815 leader_election.cc:334] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863): Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.219188 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.215833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:43361 (local address 127.0.0.1:60060)
0811 04:48:51.216040 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.216060 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.216133 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.216473 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.216477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.216493 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.216588 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.216598 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.217346 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.217351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.218203 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.218212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.218911 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.218913 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.218977 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.218995 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.219055 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.219106 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":83,"threads_started":1}
I20260811 04:48:51.219203 26402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.215990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60060 (local address 127.17.188.125:43361)
0811 04:48:51.216292 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.216299 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.216309 (+ 10us) server_negotiation.cc:407] Connection header received
0811 04:48:51.216339 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.216341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.216372 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.216462 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.216696 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.217212 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.218358 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.218810 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.218905 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.218939 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.219068 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.219120 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":120,"threads_started":1}
I20260811 04:48:51.219623 25632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5239d8681e0a45519e3822e184106118" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fe1b5c1c5276477183326ef01027c5a6" is_pre_election: true
I20260811 04:48:51.219803 25632 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5239d8681e0a45519e3822e184106118 in term 1.
I20260811 04:48:51.220114 25813 leader_election.cc:302] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5239d8681e0a45519e3822e184106118, fe1b5c1c5276477183326ef01027c5a6; no voters: 6f7b5b31db2148f4b318740a4c1aece8
I20260811 04:48:51.220324 26399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 04:48:51.220383 26399 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f7b5b31db2148f4b318740a4c1aece8)
I20260811 04:48:51.220435 26399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:48:51.221486 26399 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } }
I20260811 04:48:51.221864 26399 leader_election.cc:288] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 election: Requested vote from peers 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863), fe1b5c1c5276477183326ef01027c5a6 (127.17.188.125:43361)
I20260811 04:48:51.222179 25632 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5239d8681e0a45519e3822e184106118" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fe1b5c1c5276477183326ef01027c5a6"
I20260811 04:48:51.222270 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.222004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42360)
0811 04:48:51.222113 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.222165 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 04:48:51.222271 25632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:48:51.222856 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.222654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42368)
0811 04:48:51.222755 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.222801 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 04:48:51.223035 25815 leader_election.cc:334] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863): Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
I20260811 04:48:51.223286 25632 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5239d8681e0a45519e3822e184106118 in term 2.
I20260811 04:48:51.223536 25813 leader_election.cc:302] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5239d8681e0a45519e3822e184106118, fe1b5c1c5276477183326ef01027c5a6; no voters: 6f7b5b31db2148f4b318740a4c1aece8
I20260811 04:48:51.223749 26399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 04:48:51.223945 26399 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [term 2 LEADER]: Becoming Leader. State: Replica: 5239d8681e0a45519e3822e184106118, State: Running, Role: LEADER
I20260811 04:48:51.224208 26399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } }
I20260811 04:48:51.225170 26404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5239d8681e0a45519e3822e184106118. Latest consensus state: current_term: 2 leader_uuid: "5239d8681e0a45519e3822e184106118" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:51.225256 26404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:51.225512 26406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:51.227648 26406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:51.228041 26406 catalog_manager.cc:1259] Loaded cluster ID: 453be9c7eb924d79bc54fe35978d6831
I20260811 04:48:51.228091 26406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:51.228606 26406 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:51.228971 26406 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Loaded TSK: 0
I20260811 04:48:51.229635 26406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:48:51.262399 25828 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:51.265486 25828 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:51.268499 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.268233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42384)
0811 04:48:51.268364 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.268425 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 04:48:51.268563 25632 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [term 2 FOLLOWER]: Refusing update from remote peer 5239d8681e0a45519e3822e184106118: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260811 04:48:51.269119 26404 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 04:48:51.269235 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.269005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.0.0.1:42386)
0811 04:48:51.269118 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.269168 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 04:48:51.269426 25815 consensus_peers.cc:487] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 -> Peer 6f7b5b31db2148f4b318740a4c1aece8 (127.17.188.126:42863): Couldn't send request to peer 6f7b5b31db2148f4b318740a4c1aece8. Status: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 04:48:51.270520 26392 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5239d8681e0a45519e3822e184106118. Latest consensus state: current_term: 2 leader_uuid: "5239d8681e0a45519e3822e184106118" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:51.270653 26392 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:51.271845 26404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5239d8681e0a45519e3822e184106118" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:51.272229 26392 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5239d8681e0a45519e3822e184106118" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6f7b5b31db2148f4b318740a4c1aece8" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42863 } } peers { permanent_uuid: "fe1b5c1c5276477183326ef01027c5a6" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 43361 } attrs { promote: false } } peers { permanent_uuid: "5239d8681e0a45519e3822e184106118" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 40133 } attrs { promote: false } } }
I20260811 04:48:51.272338 26392 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe1b5c1c5276477183326ef01027c5a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:48:51.272125 26404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:51.282368 26414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.277774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55138 (local address 127.17.188.67:41091)
0811 04:48:51.278255 (+ 481us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.278259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.278273 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:51.278324 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.278329 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.278384 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.278739 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.278862 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.279661 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281198 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.281852 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281971 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.282039 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.282195 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.282262 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":91,"threads_started":1}
I20260811 04:48:51.282621 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.278285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52644 (local address 127.17.188.65:42047)
0811 04:48:51.278540 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.278544 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.278558 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:48:51.278606 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.278609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.278652 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.278965 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.279071 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.279765 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281179 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.281816 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281915 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.281974 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.282418 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.282498 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":92,"threads_started":1}
I20260811 04:48:51.282366 26401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.277642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41091 (local address 127.0.0.1:55138)
0811 04:48:51.278006 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.278038 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.278130 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.278509 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.278512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.278528 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.278632 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.278638 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.279764 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.279766 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.281049 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.281060 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.281965 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281968 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.282064 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.282085 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.282179 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.282253 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"mutex_wait_us":51}
I20260811 04:48:51.283600 26400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.277904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42047 (local address 127.0.0.1:52644)
0811 04:48:51.278079 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.278093 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.278175 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.278769 (+ 594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.278772 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.278788 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.278863 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.278869 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.279855 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.279858 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.281049 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.281060 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.282042 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.282045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.282194 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.282216 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.282283 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.282362 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":120}
I20260811 04:48:51.283924 26416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.278594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:36341 (local address 127.0.0.1:48228)
0811 04:48:51.279079 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.279092 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.279183 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.280189 (+ 1006us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.280192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.280207 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.280307 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.280313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.281001 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.281007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.282209 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.282217 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.283423 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.283427 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.283606 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.283631 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.283731 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.283795 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":42,"thread_start_us":82,"threads_started":1}
I20260811 04:48:51.284116 26253 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 (DEFAULT_TABLE table=test-table [id=678fd6e66ae74ec0ac28c099e39555be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:51.284171 25949 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 (DEFAULT_TABLE table=test-table [id=678fd6e66ae74ec0ac28c099e39555be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:51.284340 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.278707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.17.188.66:36341)
0811 04:48:51.279977 (+ 1270us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.279981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.279991 (+ 10us) server_negotiation.cc:407] Connection header received
0811 04:48:51.280032 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.280034 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.280068 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.280176 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.280415 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.280873 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.282335 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.283306 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.283410 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.283465 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.284093 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.284180 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1203,"thread_start_us":70,"threads_started":1}
I20260811 04:48:51.284421 26253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddf12fe14164abaa7ec29631316c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:51.284524 25949 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddf12fe14164abaa7ec29631316c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:51.286665 26418 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Bootstrap starting.
I20260811 04:48:51.286906 26104 tablet_service.cc:1467] Processing CreateTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 (DEFAULT_TABLE table=test-table [id=678fd6e66ae74ec0ac28c099e39555be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:51.287164 26104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ddf12fe14164abaa7ec29631316c8b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:51.287621 26418 tablet_bootstrap.cc:654] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:51.288858 26418 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: No bootstrap required, opened a new log
I20260811 04:48:51.288932 26418 ts_tablet_manager.cc:1397] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:51.289407 26418 raft_consensus.cc:348] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.289511 26418 raft_consensus.cc:374] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:51.289556 26418 raft_consensus.cc:729] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acb001cea077401bbf79dc022f508749, State: Initialized, Role: FOLLOWER
I20260811 04:48:51.289734 26418 consensus_queue.cc:260] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.289808 26421 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Bootstrap starting.
I20260811 04:48:51.290100 26418 ts_tablet_manager.cc:1428] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:51.290647 26421 tablet_bootstrap.cc:654] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:51.291101 26425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.290469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:35539)
0811 04:48:51.290956 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.291010 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":83,"threads_started":1}
I20260811 04:48:51.291376 26419 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: Bootstrap starting.
I20260811 04:48:51.291857 26427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.291471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:49623)
0811 04:48:51.291719 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.291772 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":88,"threads_started":1}
I20260811 04:48:51.292208 26419 tablet_bootstrap.cc:654] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:51.292584 26322 heartbeater.cc:503] Master 127.17.188.124:40133 was elected leader, sending a full tablet report...
I20260811 04:48:51.293401 26419 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: No bootstrap required, opened a new log
I20260811 04:48:51.293545 26419 ts_tablet_manager.cc:1397] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:51.293635 26421 tablet_bootstrap.cc:492] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: No bootstrap required, opened a new log
I20260811 04:48:51.293713 26421 ts_tablet_manager.cc:1397] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 04:48:51.294044 26419 raft_consensus.cc:348] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.294162 26419 raft_consensus.cc:374] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:51.294095 26421 raft_consensus.cc:348] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.294193 26419 raft_consensus.cc:729] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad4316a6b21e498ea33b53b7eff85899, State: Initialized, Role: FOLLOWER
I20260811 04:48:51.294219 26421 raft_consensus.cc:374] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:51.294257 26421 raft_consensus.cc:729] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a901967c9be431da5e830a1da689906, State: Initialized, Role: FOLLOWER
I20260811 04:48:51.294339 26419 consensus_queue.cc:260] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.294376 26421 consensus_queue.cc:260] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.294693 26419 ts_tablet_manager.cc:1428] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:51.296146 26421 ts_tablet_manager.cc:1428] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:51.296578 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.294946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:52041)
0811 04:48:51.296429 (+ 1483us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.296485 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1420,"thread_start_us":109,"threads_started":1}
I20260811 04:48:51.296602 26174 heartbeater.cc:503] Master 127.17.188.124:40133 was elected leader, sending a full tablet report...
I20260811 04:48:51.296759 26022 heartbeater.cc:503] Master 127.17.188.124:40133 was elected leader, sending a full tablet report...
I20260811 04:48:51.297348 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.297126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:47581)
0811 04:48:51.297232 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.297286 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 04:48:51.298200 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.295866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:46197)
0811 04:48:51.297982 (+ 2116us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.298051 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2046,"thread_start_us":87,"threads_started":1}
I20260811 04:48:51.299031 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.298790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:50075)
0811 04:48:51.298920 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.298971 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260811 04:48:51.306205 26325 tablet.cc:2369] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:48:51.359752 26177 tablet.cc:2369] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:48:51.377033 26025 tablet.cc:2369] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:51.581632 26431 raft_consensus.cc:482] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:51.581787 26431 raft_consensus.cc:504] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.582885 26431 leader_election.cc:288] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acb001cea077401bbf79dc022f508749 (127.17.188.67:41091), ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
I20260811 04:48:51.587975 26415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.583323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:53077 (local address 127.17.188.65:42047)
0811 04:48:51.583495 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.583501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.583522 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:48:51.583589 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.583593 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.583644 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.583736 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.584070 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.584906 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.586692 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.587313 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.587442 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.587493 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.587770 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.587846 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 04:48:51.587975 26414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.583329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:38035 (local address 127.17.188.67:41091)
0811 04:48:51.583490 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.583496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.583895 (+ 399us) server_negotiation.cc:407] Connection header received
0811 04:48:51.583967 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.583969 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.584038 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.584118 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:51.584372 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.585065 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.586692 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.587317 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.587442 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.587493 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.587770 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.587844 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 04:48:51.588003 26433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.583183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42047 (local address 127.17.188.66:53077)
0811 04:48:51.583314 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.583331 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.583452 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.583763 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.583769 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.583795 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.583941 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.583949 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.585059 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.585063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.586565 (+ 1502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.586576 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.587474 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.587478 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.587611 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.587659 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.587736 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.587837 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":141}
I20260811 04:48:51.588020 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.583183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:41091 (local address 127.17.188.66:38035)
0811 04:48:51.583760 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.583773 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:51.583884 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:51.584139 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:51.584141 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:51.584155 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:51.584240 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.584244 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.585172 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.585175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.586572 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:51.586578 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.587447 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.587453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:51.587622 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.587655 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 04:48:51.587736 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 04:48:51.587837 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"mutex_wait_us":350,"thread_start_us":147,"threads_started":1}
I20260811 04:48:51.588601 26274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddf12fe14164abaa7ec29631316c8b8" candidate_uuid: "4a901967c9be431da5e830a1da689906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acb001cea077401bbf79dc022f508749" is_pre_election: true
I20260811 04:48:51.588608 25971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddf12fe14164abaa7ec29631316c8b8" candidate_uuid: "4a901967c9be431da5e830a1da689906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad4316a6b21e498ea33b53b7eff85899" is_pre_election: true
I20260811 04:48:51.588763 26274 raft_consensus.cc:2454] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a901967c9be431da5e830a1da689906 in term 0.
I20260811 04:48:51.588827 25971 raft_consensus.cc:2454] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a901967c9be431da5e830a1da689906 in term 0.
I20260811 04:48:51.589247 26052 leader_election.cc:302] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4a901967c9be431da5e830a1da689906, acb001cea077401bbf79dc022f508749, ad4316a6b21e498ea33b53b7eff85899; no voters:
I20260811 04:48:51.589600 26431 raft_consensus.cc:2781] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:51.589684 26431 raft_consensus.cc:482] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:51.589723 26431 raft_consensus.cc:3037] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:51.590807 26431 raft_consensus.cc:504] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.591171 26431 leader_election.cc:288] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [CANDIDATE]: Term 1 election: Requested vote from peers acb001cea077401bbf79dc022f508749 (127.17.188.67:41091), ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047)
I20260811 04:48:51.591572 26274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddf12fe14164abaa7ec29631316c8b8" candidate_uuid: "4a901967c9be431da5e830a1da689906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acb001cea077401bbf79dc022f508749"
I20260811 04:48:51.591588 25971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ddf12fe14164abaa7ec29631316c8b8" candidate_uuid: "4a901967c9be431da5e830a1da689906" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad4316a6b21e498ea33b53b7eff85899"
I20260811 04:48:51.591679 26274 raft_consensus.cc:3037] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:51.591718 25971 raft_consensus.cc:3037] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:51.592590 26274 raft_consensus.cc:2454] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a901967c9be431da5e830a1da689906 in term 1.
I20260811 04:48:51.592748 25971 raft_consensus.cc:2454] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a901967c9be431da5e830a1da689906 in term 1.
I20260811 04:48:51.592916 26052 leader_election.cc:302] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a901967c9be431da5e830a1da689906, acb001cea077401bbf79dc022f508749; no voters:
I20260811 04:48:51.593124 26431 raft_consensus.cc:2781] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:51.593336 26431 raft_consensus.cc:686] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 1 LEADER]: Becoming Leader. State: Replica: 4a901967c9be431da5e830a1da689906, State: Running, Role: LEADER
I20260811 04:48:51.593617 26431 consensus_queue.cc:237] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } }
I20260811 04:48:51.594098 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.593806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:33051)
0811 04:48:51.593956 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.594009 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 04:48:51.596364 25829 catalog_manager.cc:5495] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a901967c9be431da5e830a1da689906 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "4a901967c9be431da5e830a1da689906" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a901967c9be431da5e830a1da689906" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 36341 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:51.645478 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.642106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33088 (local address 127.17.188.66:36341)
0811 04:48:51.642226 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:51.642231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:51.642251 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:48:51.642334 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:51.642337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:51.642392 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:51.642482 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:51.642795 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.643299 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.644122 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:51.644337 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:51.644414 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:51.644648 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:51.645099 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:51.645188 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:51.645249 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 04:48:51.645301 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 04:48:51.648350 26274 raft_consensus.cc:1261] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Refusing update from remote peer 4a901967c9be431da5e830a1da689906: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:51.648564 25971 raft_consensus.cc:1261] T 4ddf12fe14164abaa7ec29631316c8b8 P ad4316a6b21e498ea33b53b7eff85899 [term 1 FOLLOWER]: Refusing update from remote peer 4a901967c9be431da5e830a1da689906: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:51.648940 26435 consensus_queue.cc:1035] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acb001cea077401bbf79dc022f508749" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 41091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:51.649163 26431 consensus_queue.cc:1035] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad4316a6b21e498ea33b53b7eff85899" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 42047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:51.650911 26427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.650630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:35939)
0811 04:48:51.650776 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.650837 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 04:48:51.651166 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.650880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:52813)
0811 04:48:51.651037 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.651097 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 04:48:51.655591 26432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.655324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.65:58265)
0811 04:48:51.655452 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.655512 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260811 04:48:51.656222 26427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.655974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.67:38873)
0811 04:48:51.656086 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.656147 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 04:48:51.656235 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.655629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:35107)
0811 04:48:51.656093 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.656150 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389}
I20260811 04:48:51.657420 26439 mvcc.cc:205] Tried to move back new op lower bound from 7317191604826505216 to 7317191604610744320. Current Snapshot: MvccSnapshot[applied={T|T < 7317191604826505216 or (T in {7317191604826505216})}]
I20260811 04:48:51.659276 26434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.659000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42863 (local address 127.17.188.66:43839)
0811 04:48:51.659145 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.659202 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:42863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 04:48:51.664683 25827 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:51.664858 25827 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:51.668985 25827 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5239d8681e0a45519e3822e184106118: Sending DeleteTablet for 3 replicas of tablet 4ddf12fe14164abaa7ec29631316c8b8
I20260811 04:48:51.669697 26253 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:51 UTC) from {username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:55138
I20260811 04:48:51.669927 26104 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:51 UTC) from {username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:48228
I20260811 04:48:51.670275 25949 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ddf12fe14164abaa7ec29631316c8b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:51 UTC) from {username='oryx', principal='oryx/127.17.188.124@KRBTEST.COM'} at 127.0.0.1:52644
I20260811 04:48:51.670378 26449 tablet_replica.cc:330] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: stopping tablet replica
I20260811 04:48:51.670511 26449 raft_consensus.cc:2229] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:51.670624 26448 tablet_replica.cc:330] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: stopping tablet replica
I20260811 04:48:51.670782 26448 raft_consensus.cc:2229] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:51.670833 26449 raft_consensus.cc:2258] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:51.671006 26448 raft_consensus.cc:2258] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:51.671119 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25779
I20260811 04:48:51.677760 26448 ts_tablet_manager.cc:1905] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:51.678192 26449 ts_tablet_manager.cc:1905] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:51.680300 26448 ts_tablet_manager.cc:1918] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:51.680384 26448 log.cc:1196] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/4ddf12fe14164abaa7ec29631316c8b8
I20260811 04:48:51.680711 26448 ts_tablet_manager.cc:1939] T 4ddf12fe14164abaa7ec29631316c8b8 P acb001cea077401bbf79dc022f508749: Deleting consensus metadata
I20260811 04:48:51.681382 26449 ts_tablet_manager.cc:1918] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:51.681469 26449 log.cc:1196] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/4ddf12fe14164abaa7ec29631316c8b8
I20260811 04:48:51.681427 25813 catalog_manager.cc:4841] TS acb001cea077401bbf79dc022f508749 (127.17.188.67:41091): tablet 4ddf12fe14164abaa7ec29631316c8b8 (table test-table [id=678fd6e66ae74ec0ac28c099e39555be]) successfully deleted
I20260811 04:48:51.681766 26449 ts_tablet_manager.cc:1939] T 4ddf12fe14164abaa7ec29631316c8b8 P 4a901967c9be431da5e830a1da689906: Deleting consensus metadata
I20260811 04:48:51.682540 25814 catalog_manager.cc:4841] TS 4a901967c9be431da5e830a1da689906 (127.17.188.66:36341): tablet 4ddf12fe14164abaa7ec29631316c8b8 (table test-table [id=678fd6e66ae74ec0ac28c099e39555be]) successfully deleted
I20260811 04:48:51.685043 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26032
I20260811 04:48:51.686194 26416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:51.685150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:42047 (local address 127.0.0.1:49214)
0811 04:48:51.686008 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:51.686083 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:42047: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":749}
W20260811 04:48:51.686764 25815 catalog_manager.cc:4584] TS ad4316a6b21e498ea33b53b7eff85899 (127.17.188.65:42047): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ddf12fe14164abaa7ec29631316c8b8: Network error: Client connection negotiation failed: client connection to 127.17.188.65:42047: connect: Connection refused (error 111)
I20260811 04:48:51.693048 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26182
I20260811 04:48:51.700997 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25474
I20260811 04:48:51.708405 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 25589
2026-08-11T04:48:51Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5615 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:51 dist-test-slave-njxd krb5kdc[26455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:51 dist-test-slave-njxd krb5kdc[26455](info): set up 2 sockets
Aug 11 04:48:51 dist-test-slave-njxd krb5kdc[26455](info): commencing operation
krb5kdc: starting...
W20260811 04:48:52.805253 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:52 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:52Z Disabled control of system clock
WARNING: no policy specified for oryx/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab.
Entry for principal oryx/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab.
I20260811 04:48:52.930459 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:46403
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab
--principal=oryx/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:46403
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:53.037621 26468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:53.037868 26468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:53.037938 26468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:53.041926 26468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:53.041975 26468 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 04:48:53.041991 26468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:53.042039 26468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:53.042068 26468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:53.042100 26468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:53.047145 26468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:46403
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.126.keytab
--principal=oryx/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:46403
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:53.048089 26468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:53.049075 26468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:53.057230 26476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.057240 26474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.057242 26473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:53.057513 26468 server_base.cc:1034] running on GCE node
I20260811 04:48:53.058156 26468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:53.059223 26468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:53.060410 26468 hybrid_clock.cc:648] HybridClock initialized: now 1786423733060393 us; error 33 us; skew 500 ppm
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:53.067111 26468 init.cc:377] Logged in from keytab as oryx/127.17.188.126@KRBTEST.COM (short username oryx)
I20260811 04:48:53.068033 26468 webserver.cc:460] Webserver started at http://127.17.188.126:33445/ using document root <none> and password file <none>
I20260811 04:48:53.068619 26468 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:53.068710 26468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:53.068943 26468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:53.071177 26468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "f3b9b3d807304b4883a4cf919029111a"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "352bdb019eaacc3fadd1914a10d06983"
server_key_iv: "1a5898c50c67f5d8e207f0083eec1c36"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.071760 26468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "f3b9b3d807304b4883a4cf919029111a"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "352bdb019eaacc3fadd1914a10d06983"
server_key_iv: "1a5898c50c67f5d8e207f0083eec1c36"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.075922 26468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:53.078701 26484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.079857 26468 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:53.079994 26468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "f3b9b3d807304b4883a4cf919029111a"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "352bdb019eaacc3fadd1914a10d06983"
server_key_iv: "1a5898c50c67f5d8e207f0083eec1c36"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.080109 26468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:53.094436 26468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:53.097157 26468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:53.097358 26468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:53.105422 26468 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:46403
I20260811 04:48:53.105450 26554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:46403 every 8 connection(s)
I20260811 04:48:53.106389 26468 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:53.109061 26555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:53.114784 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Bootstrap starting.
I20260811 04:48:53.116488 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26468
I20260811 04:48:53.116618 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:53.116935 18161 external_mini_cluster.cc:1428] Setting key 1f01f12bb480e61587fbbb603afa43a9
I20260811 04:48:53.117537 26555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:53.118498 26555 log.cc:824] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:53.120457 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: No bootstrap required, opened a new log
I20260811 04:48:53.123847 26555 raft_consensus.cc:348] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } }
I20260811 04:48:53.124174 26555 raft_consensus.cc:374] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:53.124253 26555 raft_consensus.cc:729] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3b9b3d807304b4883a4cf919029111a, State: Initialized, Role: FOLLOWER
I20260811 04:48:53.124679 26555 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } }
I20260811 04:48:53.124799 26555 raft_consensus.cc:388] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:53.124881 26555 raft_consensus.cc:482] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:53.124985 26555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 0 FOLLOWER]: Advancing to term 1
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:53.125909 26555 raft_consensus.cc:504] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } }
I20260811 04:48:53.126236 26555 leader_election.cc:302] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f3b9b3d807304b4883a4cf919029111a; no voters:
I20260811 04:48:53.126588 26555 leader_election.cc:288] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:53.126708 26561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:53.126988 26561 raft_consensus.cc:686] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [term 1 LEADER]: Becoming Leader. State: Replica: f3b9b3d807304b4883a4cf919029111a, State: Running, Role: LEADER
I20260811 04:48:53.127333 26561 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } }
I20260811 04:48:53.128011 26555 sys_catalog.cc:564] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:53.129102 26564 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3b9b3d807304b4883a4cf919029111a. Latest consensus state: current_term: 1 leader_uuid: "f3b9b3d807304b4883a4cf919029111a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } } }
I20260811 04:48:53.129225 26564 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:53.129637 26573 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:53.129514 26562 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f3b9b3d807304b4883a4cf919029111a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f3b9b3d807304b4883a4cf919029111a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46403 } } }
I20260811 04:48:53.129738 26562 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:53.132278 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.118133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50644 (local address 127.17.188.126:46403)
0811 04:48:53.118589 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.118608 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.118643 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:48:53.119509 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.119529 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.119845 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.120186 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.120994 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.122056 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.122945 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.123434 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.123607 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.126560 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.126566 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.126583 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.126624 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.128819 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.129410 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.129416 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.129422 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.129554 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.129970 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.129975 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.129978 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.130568 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.130791 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.131071 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.131379 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":142,"threads_started":1}
I20260811 04:48:53.132916 26573 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:53.138509 26573 catalog_manager.cc:1347] Generated new cluster ID: 32de6e8f14354036b3841f241fdd3aa6
I20260811 04:48:53.138585 26573 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:53.151503 26573 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:53.153365 26573 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:53.158615 26573 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Generated new TSK 0
I20260811 04:48:53.159416 26573 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
I20260811 04:48:53.192804 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:46403
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:53.307986 26585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:53.308234 26585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:53.308276 26585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:53.312202 26585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:53.312261 26585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:53.312299 26585 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:53.312332 26585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:53.317534 26585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:46403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:53.318531 26585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:53.319564 26585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:53.329028 26591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.329030 26590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.329001 26593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:53.329445 26585 server_base.cc:1034] running on GCE node
I20260811 04:48:53.329944 26585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:53.330588 26585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:53.331775 26585 hybrid_clock.cc:648] HybridClock initialized: now 1786423733331752 us; error 33 us; skew 500 ppm
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:53.334635 26585 init.cc:377] Logged in from keytab as oryx/127.17.188.65@KRBTEST.COM (short username oryx)
I20260811 04:48:53.335507 26585 webserver.cc:460] Webserver started at http://127.17.188.65:33717/ using document root <none> and password file <none>
I20260811 04:48:53.336315 26585 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:53.336406 26585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:53.336622 26585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:53.339354 26585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "7dc41089b27a48fe8db2827c43fe1157"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "05d9075133d54ccfeeef76e0b6d72ea5"
server_key_iv: "baae5b2b7bf54c50d28c9edabf420163"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.339921 26585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "7dc41089b27a48fe8db2827c43fe1157"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "05d9075133d54ccfeeef76e0b6d72ea5"
server_key_iv: "baae5b2b7bf54c50d28c9edabf420163"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.343645 26585 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:48:53.346244 26600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.347535 26585 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:53.347708 26585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "7dc41089b27a48fe8db2827c43fe1157"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "05d9075133d54ccfeeef76e0b6d72ea5"
server_key_iv: "baae5b2b7bf54c50d28c9edabf420163"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.347833 26585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:53.366497 26585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:53.369266 26585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:53.369495 26585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:53.370986 26585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:53.371061 26585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.371141 26585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:53.371194 26585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:53.382534 26585 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37977
I20260811 04:48:53.382596 26723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37977 every 8 connection(s)
I20260811 04:48:53.383558 26585 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:53.385002 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.371880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:46625 (local address 127.17.188.126:46403)
0811 04:48:53.372026 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.372029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.373057 (+ 1028us) server_negotiation.cc:407] Connection header received
0811 04:48:53.374152 (+ 1095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.374155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.374208 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.374259 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.375670 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.376584 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.378091 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.378376 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.378476 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.381116 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.381119 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.381122 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.381149 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.382805 (+ 1656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.383362 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.383365 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.383367 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.383465 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.383878 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.383883 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.383885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.384135 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.384246 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.384760 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.384868 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:53.385802 26611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.372407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.65:46625)
0811 04:48:53.372912 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.372953 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.373852 (+ 899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.374658 (+ 806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.374666 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.375070 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.375516 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.375528 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.376716 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.376720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.377968 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.377977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.378543 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.378547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.378708 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.379243 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.379270 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.380961 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.382921 (+ 1960us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.382928 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.382940 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.383255 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.383595 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.383597 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.383598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.383776 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.384267 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.384272 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.384537 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.384683 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.384931 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":148,"threads_started":1}
I20260811 04:48:53.386983 26724 heartbeater.cc:347] Connected to a master server at 127.17.188.126:46403
I20260811 04:48:53.387172 26724 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:53.387639 26724 heartbeater.cc:511] Master 127.17.188.126:46403 requested a full tablet report, sending...
I20260811 04:48:53.389204 26503 ts_manager.cc:194] Registered new tserver with Master: 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977)
I20260811 04:48:53.389987 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26585
I20260811 04:48:53.390133 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:53.390487 18161 external_mini_cluster.cc:1428] Setting key 2ff32d7b19ff66e5c4c55cca9cfd048f
I20260811 04:48:53.390715 26503 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:46625
I20260811 04:48:53.396744 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.389176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35955 (local address 127.17.188.126:46403)
0811 04:48:53.389301 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.389305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.389470 (+ 165us) server_negotiation.cc:407] Connection header received
0811 04:48:53.389570 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.389625 (+ 55us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.389693 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.389797 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.390314 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.390978 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.392047 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.392336 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.392439 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.393789 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.393791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.393794 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.393814 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.395192 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.395582 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.395584 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.395585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.395653 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.395962 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.395965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.395967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.396123 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.396229 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.396478 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.396585 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:48:53.396754 26732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.389106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.65:35955)
0811 04:48:53.389383 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.389398 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.389492 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.389829 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.389832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.390035 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.390139 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.390145 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.391107 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.391110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.391921 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.391933 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.392467 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.392473 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.392626 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.393146 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.393165 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.393662 (+ 497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.395301 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.395305 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.395307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.395497 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.395765 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.395768 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.395770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.395868 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.396227 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.396229 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.396321 (+ 92us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.396426 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.396561 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":4,"thread_start_us":109,"threads_started":1}
WARNING: no policy specified for oryx/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
I20260811 04:48:53.420075 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:46403
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:53.531453 26735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:53.531728 26735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:53.531801 26735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:53.535755 26735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:53.535843 26735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:53.535915 26735 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:53.535993 26735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:53.541074 26735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:46403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:53.542178 26735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:53.543207 26735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:53.552860 26735 server_base.cc:1034] running on GCE node
W20260811 04:48:53.552798 26743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.552807 26741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.552822 26740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:53.553457 26735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:53.554098 26735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:53.555285 26735 hybrid_clock.cc:648] HybridClock initialized: now 1786423733555266 us; error 29 us; skew 500 ppm
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:53.558180 26735 init.cc:377] Logged in from keytab as oryx/127.17.188.66@KRBTEST.COM (short username oryx)
I20260811 04:48:53.559059 26735 webserver.cc:460] Webserver started at http://127.17.188.66:33653/ using document root <none> and password file <none>
I20260811 04:48:53.559625 26735 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:53.559716 26735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:53.559945 26735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:53.562052 26735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "de739099a8964769b80ba12970846520"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "ff9afaea7b87d1080354799000bcc980"
server_key_iv: "30eae66c527710ae62f6a2234f6c62c6"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.562650 26735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "de739099a8964769b80ba12970846520"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "ff9afaea7b87d1080354799000bcc980"
server_key_iv: "30eae66c527710ae62f6a2234f6c62c6"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.566464 26735 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 04:48:53.568921 26751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.570209 26735 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:53.570349 26735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "de739099a8964769b80ba12970846520"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "ff9afaea7b87d1080354799000bcc980"
server_key_iv: "30eae66c527710ae62f6a2234f6c62c6"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.570465 26735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:53.594101 26735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:53.597445 26735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:53.597687 26735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:53.599170 26735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:53.599243 26735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.599315 26735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:53.599349 26735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:53.610546 26735 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38265
I20260811 04:48:53.610649 26879 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38265 every 8 connection(s)
I20260811 04:48:53.611491 26735 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:53.613070 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.599970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:50033 (local address 127.17.188.126:46403)
0811 04:48:53.600125 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.600130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.600967 (+ 837us) server_negotiation.cc:407] Connection header received
0811 04:48:53.602004 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.602007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.602069 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.602173 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.603973 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.604578 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.605943 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.606276 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.606399 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.609274 (+ 2875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.609278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.609281 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.609321 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.610953 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.611508 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.611513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.611515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.611630 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.612038 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.612041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.612043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.612288 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.612392 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.612848 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.612950 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:48:53.613984 26763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.600343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.66:50033)
0811 04:48:53.600800 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.600850 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.601796 (+ 946us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.602513 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.602522 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.603079 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.603798 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.603821 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.604720 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.604723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.605802 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.605814 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.606460 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.606464 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.606720 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.607401 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.607426 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.609081 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.611077 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.611084 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.611100 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.611398 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.611747 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.611750 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.611752 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.611898 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.612402 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.612407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.612632 (+ 225us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.612792 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.613044 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":132,"threads_started":1}
I20260811 04:48:53.615428 26880 heartbeater.cc:347] Connected to a master server at 127.17.188.126:46403
I20260811 04:48:53.615604 26880 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:53.616107 26880 heartbeater.cc:511] Master 127.17.188.126:46403 requested a full tablet report, sending...
I20260811 04:48:53.617137 26504 ts_manager.cc:194] Registered new tserver with Master: de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:53.617187 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26735
I20260811 04:48:53.617321 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:53.617736 18161 external_mini_cluster.cc:1428] Setting key d5b0d0c051adfb22297e53ba2a96e3aa
I20260811 04:48:53.618062 26504 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:50033
I20260811 04:48:53.625954 26888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.617737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.66:59689)
0811 04:48:53.618101 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.618129 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.618271 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.618694 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.618697 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.618888 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.619047 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.619058 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.620037 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.620040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.620719 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.620729 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.621264 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.621270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.621374 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.621944 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.621961 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.622271 (+ 310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.624200 (+ 1929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.624202 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.624203 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.624468 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.624775 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.624777 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.624778 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.624875 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.625439 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.625441 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.625538 (+ 97us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.625703 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.625818 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"mutex_wait_us":1,"thread_start_us":102,"threads_started":1}
I20260811 04:48:53.626150 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.617826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:59689 (local address 127.17.188.126:46403)
0811 04:48:53.617941 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.617946 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.618197 (+ 251us) server_negotiation.cc:407] Connection header received
0811 04:48:53.618432 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.618436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.618482 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.618577 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.619155 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.619878 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.620847 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.621117 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.621232 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.622407 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.622414 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.622420 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.622471 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.624088 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.624571 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.624576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.624580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.624680 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.624983 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.624989 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.624993 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.625306 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.625426 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.625778 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.625915 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for oryx/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
I20260811 04:48:53.649185 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:46403
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:53.763527 26891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:53.763820 26891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:53.763899 26891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:53.767897 26891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:53.767985 26891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:53.768054 26891 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 04:48:53.768136 26891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:53.773383 26891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.17.188.126:46403
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:53.774467 26891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:53.775584 26891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:48:53.785470 26891 server_base.cc:1034] running on GCE node
W20260811 04:48:53.785678 26901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.785719 26898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:53.785707 26897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:53.786262 26891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:53.787025 26891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:53.788231 26891 hybrid_clock.cc:648] HybridClock initialized: now 1786423733788219 us; error 32 us; skew 500 ppm
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:53.791064 26891 init.cc:377] Logged in from keytab as oryx/127.17.188.67@KRBTEST.COM (short username oryx)
I20260811 04:48:53.791937 26891 webserver.cc:460] Webserver started at http://127.17.188.67:42587/ using document root <none> and password file <none>
I20260811 04:48:53.792484 26891 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:53.792573 26891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:53.792819 26891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:53.795224 26891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "f444fceb064049abb9f3208208440f11"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "6ed54b6197fe5fbf1ec67484f31992fa"
server_key_iv: "7f4113795c994d68e44d3427fd299647"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.795835 26891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "f444fceb064049abb9f3208208440f11"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "6ed54b6197fe5fbf1ec67484f31992fa"
server_key_iv: "7f4113795c994d68e44d3427fd299647"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.799705 26891 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:48:53.802148 26908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.803290 26891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:53.803422 26891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "f444fceb064049abb9f3208208440f11"
format_stamp: "Formatted at 2026-08-11 04:48:53 on dist-test-slave-njxd"
server_key: "6ed54b6197fe5fbf1ec67484f31992fa"
server_key_iv: "7f4113795c994d68e44d3427fd299647"
server_key_version: "encryptionkey@0"
I20260811 04:48:53.803530 26891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:53.817838 26891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:53.820551 26891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:53.820748 26891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:53.822268 26891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:53.822340 26891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:53.822410 26891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:53.822463 26891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:53.833299 26891 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:39559
I20260811 04:48:53.833379 27031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:39559 every 8 connection(s)
I20260811 04:48:53.834499 26891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:53.836407 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.823054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:57701 (local address 127.17.188.126:46403)
0811 04:48:53.823239 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.823245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.824003 (+ 758us) server_negotiation.cc:407] Connection header received
0811 04:48:53.824977 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.824981 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.825043 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.825104 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.826511 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.827226 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.828471 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.828825 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.828977 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.832506 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.832510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.832513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.832541 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.834291 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.834853 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.834857 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.834858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.834958 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.835355 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.835360 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.835362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.835545 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.835658 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.836133 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.836247 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 04:48:53.837170 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.823407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.67:57701)
0811 04:48:53.823834 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.823895 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.824737 (+ 842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.825564 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.825609 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.825932 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.826364 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.826377 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.827355 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.827359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.828334 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.828344 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.829024 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.829028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.829234 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.829831 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.829855 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.832347 (+ 2492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.834403 (+ 2056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.834408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.834419 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.834747 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.835075 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.835078 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.835080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.835267 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.835656 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.835663 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.835903 (+ 240us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.836095 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.836384 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":121,"threads_started":1}
I20260811 04:48:53.837189 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 26891
I20260811 04:48:53.837339 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:53.837649 18161 external_mini_cluster.cc:1428] Setting key 44ff614bbdd4759534ec5eaed933b8d0
I20260811 04:48:53.838738 27032 heartbeater.cc:347] Connected to a master server at 127.17.188.126:46403
I20260811 04:48:53.838898 27032 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:53.839368 27032 heartbeater.cc:511] Master 127.17.188.126:46403 requested a full tablet report, sending...
I20260811 04:48:53.840346 26504 ts_manager.cc:194] Registered new tserver with Master: f444fceb064049abb9f3208208440f11 (127.17.188.67:39559)
I20260811 04:48:53.841058 26504 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:57701
I20260811 04:48:53.841868 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:48:53.848621 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.840876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:35531 (local address 127.17.188.126:46403)
0811 04:48:53.841122 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.841127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.841176 (+ 49us) server_negotiation.cc:407] Connection header received
0811 04:48:53.841316 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.841319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.841364 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.841413 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.842174 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.842869 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.844104 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.844472 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.844587 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.845561 (+ 974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.845567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.845571 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.845635 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.846928 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.847460 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.847464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.847466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.847548 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.847831 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.847835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.847837 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.848000 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.848106 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.848366 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.848483 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260811 04:48:53.848629 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.840821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.17.188.67:35531)
0811 04:48:53.841110 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.841125 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.841213 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.841540 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.841543 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.841924 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:53.842044 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.842051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.843011 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.843017 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.843953 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.843967 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.844593 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.844596 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.844665 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.845142 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:53.845153 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:53.845427 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:53.847040 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.847044 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.847046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.847361 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.847649 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:53.847653 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:53.847654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:53.847740 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:53.848105 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:53.848108 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:53.848202 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.848309 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.848452 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":122,"threads_started":1}
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 04:48:53.867193 26559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:53.861484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50660 (local address 127.17.188.126:46403)
0811 04:48:53.861621 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.861625 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.861638 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:53.861679 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.861681 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.861715 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.861779 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.862508 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.862982 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.863818 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.864012 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.864082 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.867042 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50660: BlockingRecv error: recv got EOF from 127.0.0.1:50660 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 04:48:53 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:53.876644 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.868508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50662 (local address 127.17.188.126:46403)
0811 04:48:53.868658 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.868663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.868761 (+ 98us) server_negotiation.cc:407] Connection header received
0811 04:48:53.868918 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.868926 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.868964 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.869046 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:53.869722 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.870204 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.870996 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.871215 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.871335 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.873657 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:53.873660 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:53.873662 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:53.873686 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:53.874952 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.875389 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.875400 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.875402 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.875475 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:53.875759 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:53.875763 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:53.875765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:53.875952 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:53.876090 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.876347 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.876464 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 04:48:53.879429 26503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:53.882391 26503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:53.896734 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.891662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56658 (local address 127.17.188.67:39559)
0811 04:48:53.891983 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.891993 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.892015 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:48:53.892097 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.892101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.892266 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.892393 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:53.892846 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.893612 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.895387 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.895938 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.896056 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.896216 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.896483 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.896587 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":146,"threads_started":1}
I20260811 04:48:53.896818 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.890802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42302 (local address 127.17.188.65:37977)
0811 04:48:53.891154 (+ 352us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.891161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.891395 (+ 234us) server_negotiation.cc:407] Connection header received
0811 04:48:53.891510 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.891515 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.892173 (+ 658us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.892359 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:53.892686 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.893918 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.895383 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.896185 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.896331 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.896466 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.896606 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.896698 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":64,"threads_started":1}
I20260811 04:48:53.896775 27058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.890563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37977 (local address 127.0.0.1:42302)
0811 04:48:53.891285 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.891312 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.891400 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.892354 (+ 954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.892360 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.892384 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:53.892513 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.892520 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.894037 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.894040 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.895265 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.895273 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.896354 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.896360 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.896462 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.896483 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.896553 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.896625 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":39,"thread_start_us":106,"threads_started":1}
I20260811 04:48:53.896770 27061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.891245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38265 (local address 127.0.0.1:42112)
0811 04:48:53.891737 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.891751 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.891826 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.892638 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.892641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.892672 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:53.892737 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.892745 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.894070 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.894073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.895271 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.895281 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.896326 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.896330 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.896421 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.896444 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.896496 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.896622 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":427,"mutex_wait_us":74,"thread_start_us":105,"threads_started":1}
I20260811 04:48:53.897279 27059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.890525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39559 (local address 127.0.0.1:56658)
0811 04:48:53.890950 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.891002 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.891141 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.892529 (+ 1388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.892531 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.892547 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:53.892707 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.892713 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.893731 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.893736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.895237 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.895250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.896066 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.896077 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.896194 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.896240 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.896369 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.896925 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":500,"thread_start_us":70,"threads_started":1}
I20260811 04:48:53.898383 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.891434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42112 (local address 127.17.188.66:38265)
0811 04:48:53.892068 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.892082 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.892106 (+ 24us) server_negotiation.cc:407] Connection header received
0811 04:48:53.892181 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.892188 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.892476 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.892685 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:53.892821 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.893939 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.895425 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.896185 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.897961 (+ 1776us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.898116 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.898162 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.898243 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":109,"threads_started":1}
I20260811 04:48:53.899897 26657 tablet_service.cc:1467] Processing CreateTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a (DEFAULT_TABLE table=test-table [id=6d18da719d594db9bba40ea35f0ed080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:53.899914 26962 tablet_service.cc:1467] Processing CreateTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a (DEFAULT_TABLE table=test-table [id=6d18da719d594db9bba40ea35f0ed080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:53.900882 26657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fb3fcd411e497aa5f5bed5900c9f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:53.900940 26962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fb3fcd411e497aa5f5bed5900c9f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:53.900698 26808 tablet_service.cc:1467] Processing CreateTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a (DEFAULT_TABLE table=test-table [id=6d18da719d594db9bba40ea35f0ed080]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:53.901661 26808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91fb3fcd411e497aa5f5bed5900c9f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:53.907302 27064 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Bootstrap starting.
I20260811 04:48:53.908715 27065 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Bootstrap starting.
I20260811 04:48:53.909521 27066 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Bootstrap starting.
I20260811 04:48:53.909934 27064 tablet_bootstrap.cc:654] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:53.910846 27064 log.cc:824] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:53.911125 27065 tablet_bootstrap.cc:654] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:53.911343 27066 tablet_bootstrap.cc:654] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:53.912000 27065 log.cc:824] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:53.912174 27066 log.cc:824] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:53.913025 27064 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: No bootstrap required, opened a new log
I20260811 04:48:53.913240 27064 ts_tablet_manager.cc:1397] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:48:53.914137 27065 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: No bootstrap required, opened a new log
I20260811 04:48:53.914328 27065 ts_tablet_manager.cc:1397] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 04:48:53.914520 27066 tablet_bootstrap.cc:492] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: No bootstrap required, opened a new log
I20260811 04:48:53.914745 27066 ts_tablet_manager.cc:1397] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260811 04:48:53.917397 27064 raft_consensus.cc:348] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.917690 27064 raft_consensus.cc:374] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:53.917747 27064 raft_consensus.cc:729] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Initialized, Role: FOLLOWER
I20260811 04:48:53.918180 27064 consensus_queue.cc:260] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.918260 27065 raft_consensus.cc:348] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.918533 27065 raft_consensus.cc:374] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:53.918588 27065 raft_consensus.cc:729] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de739099a8964769b80ba12970846520, State: Initialized, Role: FOLLOWER
I20260811 04:48:53.918524 27066 raft_consensus.cc:348] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.918774 27066 raft_consensus.cc:374] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:53.918826 27066 raft_consensus.cc:729] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f444fceb064049abb9f3208208440f11, State: Initialized, Role: FOLLOWER
I20260811 04:48:53.918988 27065 consensus_queue.cc:260] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.919157 27066 consensus_queue.cc:260] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.919241 27064 ts_tablet_manager.cc:1428] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:48:53.919876 27065 ts_tablet_manager.cc:1428] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:48:53.919907 27066 ts_tablet_manager.cc:1428] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:48:53.919991 26724 heartbeater.cc:503] Master 127.17.188.126:46403 was elected leader, sending a full tablet report...
I20260811 04:48:53.920208 26880 heartbeater.cc:503] Master 127.17.188.126:46403 was elected leader, sending a full tablet report...
I20260811 04:48:53.920990 27032 heartbeater.cc:503] Master 127.17.188.126:46403 was elected leader, sending a full tablet report...
I20260811 04:48:53.972702 27070 raft_consensus.cc:482] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:53.972905 27070 raft_consensus.cc:504] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.974124 27070 leader_election.cc:288] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f444fceb064049abb9f3208208440f11 (127.17.188.67:39559), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:53.979040 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.974525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:55027 (local address 127.17.188.67:39559)
0811 04:48:53.974706 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.974711 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.975017 (+ 306us) server_negotiation.cc:407] Connection header received
0811 04:48:53.975167 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.975170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.975221 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.975300 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:53.975649 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.976211 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.977978 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.978417 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.978514 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.978597 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.978827 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.978904 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 04:48:53.979075 27075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.974411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38265 (local address 127.17.188.65:34579)
0811 04:48:53.975050 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.975071 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.975207 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.975490 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.975492 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.975507 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:53.975637 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.975645 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.976409 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.976411 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.977901 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.977928 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.978614 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.978621 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.978725 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.978742 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.978840 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.978903 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"mutex_wait_us":425,"thread_start_us":116,"threads_started":1}
I20260811 04:48:53.979068 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.974530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:34579 (local address 127.17.188.66:38265)
0811 04:48:53.974679 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:53.974684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:53.975194 (+ 510us) server_negotiation.cc:407] Connection header received
0811 04:48:53.975342 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:53.975346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:53.975392 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:53.975466 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:53.975754 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.976280 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.978049 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.978449 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.978596 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.978650 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:53.978871 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 04:48:53.978957 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:48:53.979079 27074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:53.974415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39559 (local address 127.17.188.65:55027)
0811 04:48:53.974899 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:53.974914 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:53.975048 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:53.975334 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:53.975337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:53.975355 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:53.975498 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.975505 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.976329 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.976333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.977852 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:53.977862 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:53.978550 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:53.978584 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:53.978681 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:53.978704 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:48:53.978777 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 04:48:53.978864 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":35,"thread_start_us":176,"threads_started":1}
I20260811 04:48:53.979791 26982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fb3fcd411e497aa5f5bed5900c9f2a" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f444fceb064049abb9f3208208440f11" is_pre_election: true
I20260811 04:48:53.979992 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fb3fcd411e497aa5f5bed5900c9f2a" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520" is_pre_election: true
I20260811 04:48:53.980162 26982 raft_consensus.cc:2454] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 0.
I20260811 04:48:53.980249 26816 raft_consensus.cc:2454] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 0.
I20260811 04:48:53.980736 26604 leader_election.cc:302] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, de739099a8964769b80ba12970846520, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:53.981060 27070 raft_consensus.cc:2781] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:53.981175 27070 raft_consensus.cc:482] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:53.981254 27070 raft_consensus.cc:3037] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:53.982446 27070 raft_consensus.cc:504] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.982821 27070 leader_election.cc:288] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 election: Requested vote from peers f444fceb064049abb9f3208208440f11 (127.17.188.67:39559), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:53.983160 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fb3fcd411e497aa5f5bed5900c9f2a" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520"
I20260811 04:48:53.983271 26816 raft_consensus.cc:3037] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:53.984450 26816 raft_consensus.cc:2454] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 1.
I20260811 04:48:53.984754 26982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91fb3fcd411e497aa5f5bed5900c9f2a" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f444fceb064049abb9f3208208440f11"
I20260811 04:48:53.984807 26603 leader_election.cc:302] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, de739099a8964769b80ba12970846520; no voters:
I20260811 04:48:53.984897 26982 raft_consensus.cc:3037] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:53.984994 27070 raft_consensus.cc:2781] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:53.985250 27070 raft_consensus.cc:686] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 1 LEADER]: Becoming Leader. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Running, Role: LEADER
I20260811 04:48:53.985626 27070 consensus_queue.cc:237] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } }
I20260811 04:48:53.986249 26982 raft_consensus.cc:2454] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 1.
I20260811 04:48:53.989230 26503 catalog_manager.cc:5495] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "7dc41089b27a48fe8db2827c43fe1157" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } health_report { overall_health: UNKNOWN } } }
I20260811 04:48:54.018887 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.015104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42312 (local address 127.17.188.65:37977)
0811 04:48:54.015245 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.015250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.015364 (+ 114us) server_negotiation.cc:407] Connection header received
0811 04:48:54.015480 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.015482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.015540 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.015638 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.015871 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.016510 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.017407 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.017659 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.017774 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.018073 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.018504 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.018648 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.018685 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.018741 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:54.024724 26982 raft_consensus.cc:1261] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Refusing update from remote peer 7dc41089b27a48fe8db2827c43fe1157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.024724 26816 raft_consensus.cc:1261] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Refusing update from remote peer 7dc41089b27a48fe8db2827c43fe1157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.025514 27070 consensus_queue.cc:1035] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.025758 27076 consensus_queue.cc:1035] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.036799 27081 mvcc.cc:205] Tried to move back new op lower bound from 7317191614557782016 to 7317191614408572928. Current Snapshot: MvccSnapshot[applied={T|T < 7317191614557782016 or (T in {7317191614557782016})}]
I20260811 04:48:54.041839 26503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.041975 26503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.044282 26503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Sending DeleteTablet for 3 replicas of tablet 91fb3fcd411e497aa5f5bed5900c9f2a
I20260811 04:48:54.044948 26962 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:56658
I20260811 04:48:54.045048 26808 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42112
I20260811 04:48:54.045229 26657 tablet_service.cc:1514] Processing DeleteTablet for tablet 91fb3fcd411e497aa5f5bed5900c9f2a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42302
I20260811 04:48:54.045532 27093 tablet_replica.cc:330] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: stopping tablet replica
I20260811 04:48:54.045732 27094 tablet_replica.cc:330] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: stopping tablet replica
I20260811 04:48:54.045826 27093 raft_consensus.cc:2229] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.046134 27094 raft_consensus.cc:2229] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:54.046175 27093 raft_consensus.cc:2258] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.046254 26503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:54.046689 26503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:54.046707 27094 raft_consensus.cc:2258] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.047755 27093 ts_tablet_manager.cc:1905] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.048130 27094 ts_tablet_manager.cc:1905] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.048204 27092 tablet_replica.cc:330] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: stopping tablet replica
I20260811 04:48:54.048488 27092 raft_consensus.cc:2229] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.048766 27092 raft_consensus.cc:2258] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.051054 27094 ts_tablet_manager.cc:1918] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.051205 27094 log.cc:1196] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/91fb3fcd411e497aa5f5bed5900c9f2a
I20260811 04:48:54.051564 27094 ts_tablet_manager.cc:1939] T 91fb3fcd411e497aa5f5bed5900c9f2a P 7dc41089b27a48fe8db2827c43fe1157: Deleting consensus metadata
I20260811 04:48:54.052680 26808 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5136c7f35644959749e605d78f2ee2 (DEFAULT_TABLE table=test-table [id=3ec1a98cc65d44339604ce32bc445396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.052798 26962 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5136c7f35644959749e605d78f2ee2 (DEFAULT_TABLE table=test-table [id=3ec1a98cc65d44339604ce32bc445396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.052995 26808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5136c7f35644959749e605d78f2ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.052968 26657 tablet_service.cc:1467] Processing CreateTablet for tablet 9a5136c7f35644959749e605d78f2ee2 (DEFAULT_TABLE table=test-table [id=3ec1a98cc65d44339604ce32bc445396]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.053040 26962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5136c7f35644959749e605d78f2ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.053186 26657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a5136c7f35644959749e605d78f2ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.055406 27065 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Bootstrap starting.
I20260811 04:48:54.055424 27066 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Bootstrap starting.
I20260811 04:48:54.055599 27093 ts_tablet_manager.cc:1918] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.055689 27093 log.cc:1196] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/91fb3fcd411e497aa5f5bed5900c9f2a
I20260811 04:48:54.056011 27093 ts_tablet_manager.cc:1939] T 91fb3fcd411e497aa5f5bed5900c9f2a P de739099a8964769b80ba12970846520: Deleting consensus metadata
I20260811 04:48:54.056361 27066 tablet_bootstrap.cc:654] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.056455 27065 tablet_bootstrap.cc:654] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.056901 27064 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Bootstrap starting.
I20260811 04:48:54.057222 26486 catalog_manager.cc:4841] TS de739099a8964769b80ba12970846520 (127.17.188.66:38265): tablet 91fb3fcd411e497aa5f5bed5900c9f2a (table test-table [id=6d18da719d594db9bba40ea35f0ed080]) successfully deleted
I20260811 04:48:54.057385 26486 catalog_manager.cc:4841] TS 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977): tablet 91fb3fcd411e497aa5f5bed5900c9f2a (table test-table [id=6d18da719d594db9bba40ea35f0ed080]) successfully deleted
I20260811 04:48:54.057804 27065 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: No bootstrap required, opened a new log
I20260811 04:48:54.057817 27064 tablet_bootstrap.cc:654] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.057883 27065 ts_tablet_manager.cc:1397] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 04:48:54.058320 27065 raft_consensus.cc:348] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.058481 27065 raft_consensus.cc:374] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.058526 27065 raft_consensus.cc:729] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de739099a8964769b80ba12970846520, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.058651 27065 consensus_queue.cc:260] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.058909 27065 ts_tablet_manager.cc:1428] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.059520 27064 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: No bootstrap required, opened a new log
I20260811 04:48:54.059597 27064 ts_tablet_manager.cc:1397] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 04:48:54.059692 27092 ts_tablet_manager.cc:1905] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.059962 27064 raft_consensus.cc:348] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.060056 27064 raft_consensus.cc:374] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.060094 27064 raft_consensus.cc:729] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.060190 27064 consensus_queue.cc:260] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.060392 27064 ts_tablet_manager.cc:1428] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.061168 27066 tablet_bootstrap.cc:492] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: No bootstrap required, opened a new log
I20260811 04:48:54.061244 27066 ts_tablet_manager.cc:1397] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 04:48:54.061647 27066 raft_consensus.cc:348] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.061751 27066 raft_consensus.cc:374] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.061780 27066 raft_consensus.cc:729] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f444fceb064049abb9f3208208440f11, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.061887 27066 consensus_queue.cc:260] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.062146 27066 ts_tablet_manager.cc:1428] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.065958 27092 ts_tablet_manager.cc:1918] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.066071 27092 log.cc:1196] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/91fb3fcd411e497aa5f5bed5900c9f2a
I20260811 04:48:54.066385 27092 ts_tablet_manager.cc:1939] T 91fb3fcd411e497aa5f5bed5900c9f2a P f444fceb064049abb9f3208208440f11: Deleting consensus metadata
I20260811 04:48:54.067600 26488 catalog_manager.cc:4841] TS f444fceb064049abb9f3208208440f11 (127.17.188.67:39559): tablet 91fb3fcd411e497aa5f5bed5900c9f2a (table test-table [id=6d18da719d594db9bba40ea35f0ed080]) successfully deleted
W20260811 04:48:54.085538 27033 tablet.cc:2369] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:48:54.112676 26882 tablet.cc:2369] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:54.128895 27086 raft_consensus.cc:482] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:54.129047 27086 raft_consensus.cc:504] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.129565 27086 leader_election.cc:288] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de739099a8964769b80ba12970846520 (127.17.188.66:38265), f444fceb064049abb9f3208208440f11 (127.17.188.67:39559)
I20260811 04:48:54.130007 26982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5136c7f35644959749e605d78f2ee2" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f444fceb064049abb9f3208208440f11" is_pre_election: true
I20260811 04:48:54.130031 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5136c7f35644959749e605d78f2ee2" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520" is_pre_election: true
I20260811 04:48:54.130179 26982 raft_consensus.cc:2454] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 0.
I20260811 04:48:54.130187 26816 raft_consensus.cc:2454] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 0.
I20260811 04:48:54.130463 26603 leader_election.cc:302] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, de739099a8964769b80ba12970846520; no voters:
I20260811 04:48:54.130640 27086 raft_consensus.cc:2781] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:54.130707 27086 raft_consensus.cc:482] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:54.130760 27086 raft_consensus.cc:3037] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.131716 27086 raft_consensus.cc:504] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.132069 27086 leader_election.cc:288] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 election: Requested vote from peers de739099a8964769b80ba12970846520 (127.17.188.66:38265), f444fceb064049abb9f3208208440f11 (127.17.188.67:39559)
I20260811 04:48:54.132373 26982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5136c7f35644959749e605d78f2ee2" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f444fceb064049abb9f3208208440f11"
I20260811 04:48:54.132375 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a5136c7f35644959749e605d78f2ee2" candidate_uuid: "7dc41089b27a48fe8db2827c43fe1157" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520"
I20260811 04:48:54.132499 26982 raft_consensus.cc:3037] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.132509 26816 raft_consensus.cc:3037] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.133680 26982 raft_consensus.cc:2454] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 1.
I20260811 04:48:54.133680 26816 raft_consensus.cc:2454] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7dc41089b27a48fe8db2827c43fe1157 in term 1.
I20260811 04:48:54.133958 26603 leader_election.cc:302] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, de739099a8964769b80ba12970846520; no voters:
I20260811 04:48:54.134132 27086 raft_consensus.cc:2781] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:54.134229 27086 raft_consensus.cc:686] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 LEADER]: Becoming Leader. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Running, Role: LEADER
I20260811 04:48:54.134357 27086 consensus_queue.cc:237] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
W20260811 04:48:54.135133 26725 tablet.cc:2369] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:48:54.135946 26502 catalog_manager.cc:5495] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "7dc41089b27a48fe8db2827c43fe1157" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } health_report { overall_health: UNKNOWN } } }
Aug 11 04:48:54 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423733, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.126@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:54.189164 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.179241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:46403 (local address 127.0.0.1:50674)
0811 04:48:54.179555 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.179577 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.179683 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.179944 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.179946 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.180326 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:54.180418 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.180424 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.181486 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.181489 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.182173 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.182184 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.182721 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.182724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.182819 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.183402 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:54.183439 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:54.185263 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:54.187545 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:54.187554 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:54.187560 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:54.187921 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:54.188222 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:54.188224 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:54.188226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:54.188307 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:54.188705 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:54.188710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:54.188813 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.188904 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.189024 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":19,"thread_start_us":107,"threads_started":1}
I20260811 04:48:54.189289 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.179351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.17.188.126:46403)
0811 04:48:54.179500 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.179505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.179654 (+ 149us) server_negotiation.cc:407] Connection header received
0811 04:48:54.179768 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.179772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.179819 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.179911 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:54.180555 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.181371 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.182292 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.182617 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.182725 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.185412 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:54.185418 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:54.185421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:54.185455 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:54.187384 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:54.188016 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:54.188019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:54.188021 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:54.188126 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:54.188393 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:54.188396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:54.188398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:54.188606 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:54.188698 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.188977 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.189099 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":58}
I20260811 04:48:54.193528 26502 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:50674:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 04:48:54.194334 26502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:54.199188 26657 tablet_service.cc:1467] Processing CreateTablet for tablet ae32858d84af4f758ed18921a25bb1c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2b92431dd00745baae0ef53ff70a17a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:54.199271 26808 tablet_service.cc:1467] Processing CreateTablet for tablet ae32858d84af4f758ed18921a25bb1c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2b92431dd00745baae0ef53ff70a17a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:54.199374 26962 tablet_service.cc:1467] Processing CreateTablet for tablet ae32858d84af4f758ed18921a25bb1c1 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2b92431dd00745baae0ef53ff70a17a0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 04:48:54.199594 26657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae32858d84af4f758ed18921a25bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.199662 26808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae32858d84af4f758ed18921a25bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.199716 26962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae32858d84af4f758ed18921a25bb1c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.202013 27065 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: Bootstrap starting.
I20260811 04:48:54.202492 27066 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: Bootstrap starting.
I20260811 04:48:54.202492 27064 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: Bootstrap starting.
I20260811 04:48:54.202956 27065 tablet_bootstrap.cc:654] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.203305 27064 tablet_bootstrap.cc:654] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.203363 27066 tablet_bootstrap.cc:654] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.204334 27065 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: No bootstrap required, opened a new log
I20260811 04:48:54.204417 27064 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: No bootstrap required, opened a new log
I20260811 04:48:54.204417 27066 tablet_bootstrap.cc:492] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: No bootstrap required, opened a new log
I20260811 04:48:54.204435 27065 ts_tablet_manager.cc:1397] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:54.204496 27064 ts_tablet_manager.cc:1397] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:54.204496 27066 ts_tablet_manager.cc:1397] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:54.204805 27065 raft_consensus.cc:348] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.204855 27064 raft_consensus.cc:348] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.204855 27066 raft_consensus.cc:348] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.204912 27065 raft_consensus.cc:374] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.204953 27065 raft_consensus.cc:729] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de739099a8964769b80ba12970846520, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.204958 27066 raft_consensus.cc:374] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.204958 27064 raft_consensus.cc:374] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.204993 27066 raft_consensus.cc:729] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f444fceb064049abb9f3208208440f11, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.204993 27064 raft_consensus.cc:729] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.205075 27065 consensus_queue.cc:260] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.205103 27066 consensus_queue.cc:260] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.205103 27064 consensus_queue.cc:260] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.205335 27066 ts_tablet_manager.cc:1428] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.205349 27065 ts_tablet_manager.cc:1428] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:48:54.205322 27086 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.205335 27064 ts_tablet_manager.cc:1428] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.205458 27086 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.205529 27071 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.205696 27071 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.205915 27073 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.206071 27073 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.227054 27073 raft_consensus.cc:482] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:54.227160 27073 raft_consensus.cc:504] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.228258 27073 leader_election.cc:288] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.232717 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.228546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:36197 (local address 127.17.188.65:37977)
0811 04:48:54.228794 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.228798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.228813 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:48:54.228969 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.228972 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.229023 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.229106 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:54.229430 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.230350 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.231611 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.232174 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.232306 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.232357 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.232553 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.232624 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260811 04:48:54.232718 26919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.228428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37977 (local address 127.17.188.67:36197)
0811 04:48:54.228728 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.228748 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.228846 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.229148 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.229153 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.229176 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:54.229314 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.229321 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.230450 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.230453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.231486 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.231495 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.232315 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.232318 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.232422 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.232447 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.232531 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.232596 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 04:48:54.233425 27108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.228717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:38265 (local address 127.17.188.67:41155)
0811 04:48:54.229137 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.229150 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.229245 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.229495 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.229498 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.229514 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:48:54.230185 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.230195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.231169 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.231171 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.232197 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.232209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.233017 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.233021 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.233139 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.233162 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.233236 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.233296 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":159,"threads_started":1}
I20260811 04:48:54.233459 27062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.228833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:41155 (local address 127.17.188.66:38265)
0811 04:48:54.228952 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.228957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.229227 (+ 270us) server_negotiation.cc:407] Connection header received
0811 04:48:54.229321 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.229324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.229378 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.229469 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:48:54.230300 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.231024 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.232318 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.232897 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.233013 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.233048 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.233271 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.233354 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:48:54.233493 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae32858d84af4f758ed18921a25bb1c1" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157" is_pre_election: true
I20260811 04:48:54.233750 26678 raft_consensus.cc:2454] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.234071 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae32858d84af4f758ed18921a25bb1c1" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520" is_pre_election: true
I20260811 04:48:54.234212 26816 raft_consensus.cc:2454] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.234248 26910 leader_election.cc:302] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.234530 27073 raft_consensus.cc:2781] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:54.234599 27073 raft_consensus.cc:482] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:54.234629 27073 raft_consensus.cc:3037] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.235567 27073 raft_consensus.cc:504] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.235901 27073 leader_election.cc:288] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Requested vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.236297 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae32858d84af4f758ed18921a25bb1c1" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157"
I20260811 04:48:54.236346 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae32858d84af4f758ed18921a25bb1c1" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520"
I20260811 04:48:54.236402 26678 raft_consensus.cc:3037] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.236490 26816 raft_consensus.cc:3037] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.237353 26678 raft_consensus.cc:2454] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.237398 26816 raft_consensus.cc:2454] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.237663 26910 leader_election.cc:302] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.237828 27073 raft_consensus.cc:2781] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:54.238059 27073 raft_consensus.cc:686] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [term 1 LEADER]: Becoming Leader. State: Replica: f444fceb064049abb9f3208208440f11, State: Running, Role: LEADER
I20260811 04:48:54.238335 27073 consensus_queue.cc:237] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.239641 27109 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: TxnStatusTablet state changed. Reason: New leader f444fceb064049abb9f3208208440f11. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.239748 27109 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:54.240063 27111 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 04:48:54.240204 27111 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 04:48:54.240785 26502 catalog_manager.cc:5495] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to f444fceb064049abb9f3208208440f11 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:54.258942 27104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.255163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39559 (local address 127.0.0.1:56662)
0811 04:48:54.255364 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.255377 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.255465 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.255809 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.255812 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.255818 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:54.255928 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.255933 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.256662 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.256665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.257293 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.257301 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.257822 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.257826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.257918 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.257963 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.258650 (+ 687us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.258669 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.258740 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.258828 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 04:48:54.258942 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.255284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56662 (local address 127.17.188.67:39559)
0811 04:48:54.255416 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.255421 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.255437 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:54.255619 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.255622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.255675 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.255780 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.256033 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.256525 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.257423 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.257711 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.257821 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.258117 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.258528 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.258672 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.258749 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.258803 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 04:48:54.261781 26816 raft_consensus.cc:1261] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.261900 26678 raft_consensus.cc:1261] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.262280 27073 consensus_queue.cc:1035] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.262437 27109 consensus_queue.cc:1035] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.263854 27071 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: TxnStatusTablet state changed. Reason: New leader f444fceb064049abb9f3208208440f11. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.263965 27071 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.265195 27073 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.265297 27073 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:54.265594 27086 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: TxnStatusTablet state changed. Reason: New leader f444fceb064049abb9f3208208440f11. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.265728 27086 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.266206 27071 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.266299 27071 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P de739099a8964769b80ba12970846520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.266492 27082 mvcc.cc:205] Tried to move back new op lower bound from 7317191615530680320 to 7317191615442620416. Current Snapshot: MvccSnapshot[applied={T|T < 7317191615530680320 or (T in {7317191615530680320})}]
I20260811 04:48:54.270390 27073 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.270493 27073 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P f444fceb064049abb9f3208208440f11: This TxnStatusTablet replica's current role is: LEADER
I20260811 04:48:54.271034 27079 mvcc.cc:205] Tried to move back new op lower bound from 7317191615530680320 to 7317191615442620416. Current Snapshot: MvccSnapshot[applied={T|T < 7317191615530680320}]
I20260811 04:48:54.271189 27086 tablet_replica.cc:439] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } } }
I20260811 04:48:54.271276 27086 tablet_replica.cc:442] T ae32858d84af4f758ed18921a25bb1c1 P 7dc41089b27a48fe8db2827c43fe1157: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 04:48:54.280486 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.277056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:44207 (local address 127.17.188.67:39559)
0811 04:48:54.277208 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.277213 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.277399 (+ 186us) server_negotiation.cc:407] Connection header received
0811 04:48:54.277520 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.277522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.277559 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.277696 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.277910 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.278387 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.279542 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.279775 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.279842 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.280141 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.280198 (+ 57us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.280244 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.280361 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.280398 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:48:54.280565 27119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.276992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39559 (local address 127.17.188.65:44207)
0811 04:48:54.277309 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.277326 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.277435 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.277707 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.277710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.277719 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:54.277821 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.277827 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.278483 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.278487 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.279425 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.279436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.279872 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.279876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.279963 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.280012 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.280273 (+ 261us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.280280 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.280345 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.280428 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":123,"threads_started":1}
I20260811 04:48:54.286521 26982 raft_consensus.cc:1261] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Refusing update from remote peer 7dc41089b27a48fe8db2827c43fe1157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.286540 26816 raft_consensus.cc:1261] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Refusing update from remote peer 7dc41089b27a48fe8db2827c43fe1157: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.286861 27070 consensus_queue.cc:1035] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.286996 27086 consensus_queue.cc:1035] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.308176 27060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.304833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:46269 (local address 127.17.188.65:37977)
0811 04:48:54.304971 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.304974 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.304985 (+ 11us) server_negotiation.cc:407] Connection header received
0811 04:48:54.305052 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.305054 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.305087 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.305147 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.305411 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.306141 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.307056 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.307413 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.307545 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.307778 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.307854 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.307926 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.308002 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.308055 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 04:48:54.308153 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.304688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37977 (local address 127.17.188.67:46269)
0811 04:48:54.304864 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.304878 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.304971 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.305182 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.305184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.305191 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:54.305295 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.305300 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.306278 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.306281 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.306942 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.306952 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.307529 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.307532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.307609 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.307654 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.307939 (+ 285us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.307943 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.307992 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.308055 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 04:48:54.327200 26502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.327364 26502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.329463 26502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Sending DeleteTablet for 3 replicas of tablet 9a5136c7f35644959749e605d78f2ee2
I20260811 04:48:54.329965 26657 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a5136c7f35644959749e605d78f2ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42302
I20260811 04:48:54.330189 27094 tablet_replica.cc:330] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: stopping tablet replica
I20260811 04:48:54.330209 26808 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a5136c7f35644959749e605d78f2ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42112
I20260811 04:48:54.330328 27094 raft_consensus.cc:2229] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:54.330379 27093 tablet_replica.cc:330] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: stopping tablet replica
I20260811 04:48:54.330490 27093 raft_consensus.cc:2229] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.330509 27094 raft_consensus.cc:2258] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.330580 27093 raft_consensus.cc:2258] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.330672 26962 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a5136c7f35644959749e605d78f2ee2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:56658
I20260811 04:48:54.330840 27092 tablet_replica.cc:330] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: stopping tablet replica
I20260811 04:48:54.330961 27092 raft_consensus.cc:2229] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.331060 27092 raft_consensus.cc:2258] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.331310 27093 ts_tablet_manager.cc:1905] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.331424 27094 ts_tablet_manager.cc:1905] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.333642 27094 ts_tablet_manager.cc:1918] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:54.333721 27094 log.cc:1196] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/9a5136c7f35644959749e605d78f2ee2
I20260811 04:48:54.333912 27094 ts_tablet_manager.cc:1939] T 9a5136c7f35644959749e605d78f2ee2 P 7dc41089b27a48fe8db2827c43fe1157: Deleting consensus metadata
I20260811 04:48:54.334049 27093 ts_tablet_manager.cc:1918] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:54.334113 27093 log.cc:1196] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9a5136c7f35644959749e605d78f2ee2
I20260811 04:48:54.334362 27093 ts_tablet_manager.cc:1939] T 9a5136c7f35644959749e605d78f2ee2 P de739099a8964769b80ba12970846520: Deleting consensus metadata
I20260811 04:48:54.334487 26486 catalog_manager.cc:4841] TS 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977): tablet 9a5136c7f35644959749e605d78f2ee2 (table test-table [id=3ec1a98cc65d44339604ce32bc445396]) successfully deleted
I20260811 04:48:54.335014 26486 catalog_manager.cc:4841] TS de739099a8964769b80ba12970846520 (127.17.188.66:38265): tablet 9a5136c7f35644959749e605d78f2ee2 (table test-table [id=3ec1a98cc65d44339604ce32bc445396]) successfully deleted
I20260811 04:48:54.339112 27092 ts_tablet_manager.cc:1905] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.342135 27092 ts_tablet_manager.cc:1918] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:54.342218 27092 log.cc:1196] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9a5136c7f35644959749e605d78f2ee2
I20260811 04:48:54.342482 27092 ts_tablet_manager.cc:1939] T 9a5136c7f35644959749e605d78f2ee2 P f444fceb064049abb9f3208208440f11: Deleting consensus metadata
I20260811 04:48:54.343089 26488 catalog_manager.cc:4841] TS f444fceb064049abb9f3208208440f11 (127.17.188.67:39559): tablet 9a5136c7f35644959749e605d78f2ee2 (table test-table [id=3ec1a98cc65d44339604ce32bc445396]) successfully deleted
Aug 11 04:48:54 dist-test-slave-njxd krb5kdc[26455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 04:48:54 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:54 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 04:48:54.365944 26559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:54.359127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50690 (local address 127.17.188.126:46403)
0811 04:48:54.359292 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.359298 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.359510 (+ 212us) server_negotiation.cc:407] Connection header received
0811 04:48:54.359654 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.359657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.359697 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.359762 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:54.360640 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.361209 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.362444 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.362651 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.362731 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.365802 (+ 3071us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50690: BlockingRecv error: recv got EOF from 127.0.0.1:50690 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 04:48:54 dist-test-slave-njxd krb5kdc[26455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423734, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM
I20260811 04:48:54.375751 26559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.367314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50702 (local address 127.17.188.126:46403)
0811 04:48:54.367421 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.367425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.367640 (+ 215us) server_negotiation.cc:407] Connection header received
0811 04:48:54.367790 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.367795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.367838 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.367918 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:54.368511 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.368979 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.369864 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.370070 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.370181 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.372401 (+ 2220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:54.372404 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:54.372407 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:54.372430 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:54.373875 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:54.374346 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:54.374354 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:54.374355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:54.374455 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:54.374828 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:54.374832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:54.374833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:54.375066 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:54.375231 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.375464 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.375585 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:48:54.378527 26502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:54.379016 26502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:54.384047 26962 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (DEFAULT_TABLE table=test-table [id=546573ccd4dd48b6be90352b75292f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.384407 26962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.386901 27066 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Bootstrap starting.
I20260811 04:48:54.387876 27066 tablet_bootstrap.cc:654] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.388718 26657 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (DEFAULT_TABLE table=test-table [id=546573ccd4dd48b6be90352b75292f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.389001 26657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.390077 26808 tablet_service.cc:1467] Processing CreateTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (DEFAULT_TABLE table=test-table [id=546573ccd4dd48b6be90352b75292f90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.390414 26808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.392258 27065 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Bootstrap starting.
I20260811 04:48:54.393199 27065 tablet_bootstrap.cc:654] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.394181 27064 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Bootstrap starting.
I20260811 04:48:54.394891 27066 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: No bootstrap required, opened a new log
I20260811 04:48:54.394980 27066 ts_tablet_manager.cc:1397] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 04:48:54.395025 27064 tablet_bootstrap.cc:654] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.395486 27066 raft_consensus.cc:348] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.395628 27066 raft_consensus.cc:374] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.395668 27066 raft_consensus.cc:729] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f444fceb064049abb9f3208208440f11, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.395813 27066 consensus_queue.cc:260] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.396797 27066 ts_tablet_manager.cc:1428] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:54.398124 27064 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: No bootstrap required, opened a new log
I20260811 04:48:54.398236 27064 ts_tablet_manager.cc:1397] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 04:48:54.398681 27064 raft_consensus.cc:348] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.398798 27064 raft_consensus.cc:374] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.398840 27064 raft_consensus.cc:729] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.398973 27064 consensus_queue.cc:260] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.399248 27064 ts_tablet_manager.cc:1428] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.400520 27065 tablet_bootstrap.cc:492] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: No bootstrap required, opened a new log
I20260811 04:48:54.400612 27065 ts_tablet_manager.cc:1397] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 04:48:54.401109 27065 raft_consensus.cc:348] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.401225 27065 raft_consensus.cc:374] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.401259 27065 raft_consensus.cc:729] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de739099a8964769b80ba12970846520, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.401386 27065 consensus_queue.cc:260] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.401656 27065 ts_tablet_manager.cc:1428] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 04:48:54.658003 27109 raft_consensus.cc:482] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:54.658136 27109 raft_consensus.cc:504] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.658656 27109 leader_election.cc:288] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.659219 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8ac0cb5ec496b9fdb4b911a49b2fe" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157" is_pre_election: true
I20260811 04:48:54.659230 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8ac0cb5ec496b9fdb4b911a49b2fe" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520" is_pre_election: true
I20260811 04:48:54.659387 26816 raft_consensus.cc:2454] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.659387 26678 raft_consensus.cc:2454] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.659723 26910 leader_election.cc:302] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de739099a8964769b80ba12970846520, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.659907 27109 raft_consensus.cc:2781] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:54.659967 27109 raft_consensus.cc:482] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:54.660007 27109 raft_consensus.cc:3037] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.661002 27109 raft_consensus.cc:504] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.661341 27109 leader_election.cc:288] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Requested vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.661717 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8ac0cb5ec496b9fdb4b911a49b2fe" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157"
I20260811 04:48:54.661746 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "51d8ac0cb5ec496b9fdb4b911a49b2fe" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520"
I20260811 04:48:54.661849 26678 raft_consensus.cc:3037] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.661892 26816 raft_consensus.cc:3037] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.662774 26678 raft_consensus.cc:2454] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.662813 26816 raft_consensus.cc:2454] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.663061 26910 leader_election.cc:302] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.663235 27109 raft_consensus.cc:2781] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:54.663323 27109 raft_consensus.cc:686] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 1 LEADER]: Becoming Leader. State: Replica: f444fceb064049abb9f3208208440f11, State: Running, Role: LEADER
I20260811 04:48:54.663468 27109 consensus_queue.cc:237] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.665086 26503 catalog_manager.cc:5495] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to f444fceb064049abb9f3208208440f11 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:54.692677 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.689763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56674 (local address 127.17.188.67:39559)
0811 04:48:54.689897 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.689901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.689916 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:48:54.690054 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.690057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.690112 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.690188 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.690427 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.690879 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.691686 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.691917 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.692038 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.692282 (+ 244us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.692341 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.692414 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.692502 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.692545 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:48:54.694784 26816 raft_consensus.cc:1261] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.694847 26678 raft_consensus.cc:1261] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.695211 27109 consensus_queue.cc:1035] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.695348 27073 consensus_queue.cc:1035] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.704022 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.704159 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.706120 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Sending DeleteTablet for 3 replicas of tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe
I20260811 04:48:54.706691 26657 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42302
I20260811 04:48:54.706729 26962 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:56658
I20260811 04:48:54.706848 27094 tablet_replica.cc:330] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: stopping tablet replica
I20260811 04:48:54.706878 27092 tablet_replica.cc:330] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: stopping tablet replica
I20260811 04:48:54.706864 26808 tablet_service.cc:1514] Processing DeleteTablet for tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42112
I20260811 04:48:54.706971 27092 raft_consensus.cc:2229] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:54.706977 27094 raft_consensus.cc:2229] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.707091 27094 raft_consensus.cc:2258] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.707260 27092 raft_consensus.cc:2258] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.707454 27093 tablet_replica.cc:330] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: stopping tablet replica
I20260811 04:48:54.707587 27093 raft_consensus.cc:2229] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.707710 27093 raft_consensus.cc:2258] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.707858 27094 ts_tablet_manager.cc:1905] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.708029 27092 ts_tablet_manager.cc:1905] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.707986 26501 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:48:54.708379 26501 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:48:54.710263 27094 ts_tablet_manager.cc:1918] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.710325 27094 log.cc:1196] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/51d8ac0cb5ec496b9fdb4b911a49b2fe
I20260811 04:48:54.710409 27092 ts_tablet_manager.cc:1918] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.710476 27092 log.cc:1196] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/51d8ac0cb5ec496b9fdb4b911a49b2fe
I20260811 04:48:54.710577 27094 ts_tablet_manager.cc:1939] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P 7dc41089b27a48fe8db2827c43fe1157: Deleting consensus metadata
I20260811 04:48:54.710762 27092 ts_tablet_manager.cc:1939] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P f444fceb064049abb9f3208208440f11: Deleting consensus metadata
I20260811 04:48:54.711151 27093 ts_tablet_manager.cc:1905] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.711663 26486 catalog_manager.cc:4841] TS 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977): tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (table test-table [id=546573ccd4dd48b6be90352b75292f90]) successfully deleted
I20260811 04:48:54.713042 27093 ts_tablet_manager.cc:1918] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:48:54.713141 27093 log.cc:1196] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/51d8ac0cb5ec496b9fdb4b911a49b2fe
I20260811 04:48:54.713354 27093 ts_tablet_manager.cc:1939] T 51d8ac0cb5ec496b9fdb4b911a49b2fe P de739099a8964769b80ba12970846520: Deleting consensus metadata
I20260811 04:48:54.714133 26486 catalog_manager.cc:4841] TS de739099a8964769b80ba12970846520 (127.17.188.66:38265): tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (table test-table [id=546573ccd4dd48b6be90352b75292f90]) successfully deleted
I20260811 04:48:54.714171 26488 catalog_manager.cc:4841] TS f444fceb064049abb9f3208208440f11 (127.17.188.67:39559): tablet 51d8ac0cb5ec496b9fdb4b911a49b2fe (table test-table [id=546573ccd4dd48b6be90352b75292f90]) successfully deleted
I20260811 04:48:54.715104 26808 tablet_service.cc:1467] Processing CreateTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 (DEFAULT_TABLE table=test-table [id=4a9af00a9c2e414c9135646cc0a60fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.715142 26657 tablet_service.cc:1467] Processing CreateTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 (DEFAULT_TABLE table=test-table [id=4a9af00a9c2e414c9135646cc0a60fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.715349 26808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2085ce9ecd1940d69a495d3e8d13b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.715386 26657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2085ce9ecd1940d69a495d3e8d13b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.716526 26962 tablet_service.cc:1467] Processing CreateTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 (DEFAULT_TABLE table=test-table [id=4a9af00a9c2e414c9135646cc0a60fab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:48:54.716756 26962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2085ce9ecd1940d69a495d3e8d13b8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:54.717411 27065 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Bootstrap starting.
I20260811 04:48:54.718124 27064 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: Bootstrap starting.
I20260811 04:48:54.718274 27065 tablet_bootstrap.cc:654] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.718910 27064 tablet_bootstrap.cc:654] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.718910 27066 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Bootstrap starting.
I20260811 04:48:54.719609 27066 tablet_bootstrap.cc:654] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:54.719940 27064 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: No bootstrap required, opened a new log
I20260811 04:48:54.720054 27064 ts_tablet_manager.cc:1397] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:54.720415 27064 raft_consensus.cc:348] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.720525 27064 raft_consensus.cc:374] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.720564 27064 raft_consensus.cc:729] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7dc41089b27a48fe8db2827c43fe1157, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.720690 27064 consensus_queue.cc:260] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.720979 27064 ts_tablet_manager.cc:1428] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.721068 27066 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: No bootstrap required, opened a new log
I20260811 04:48:54.721159 27066 ts_tablet_manager.cc:1397] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:54.721510 27066 raft_consensus.cc:348] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.721634 27066 raft_consensus.cc:374] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.721668 27066 raft_consensus.cc:729] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f444fceb064049abb9f3208208440f11, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.721771 27066 consensus_queue.cc:260] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.722008 27066 ts_tablet_manager.cc:1428] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.722014 27065 tablet_bootstrap.cc:492] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: No bootstrap required, opened a new log
I20260811 04:48:54.722087 27065 ts_tablet_manager.cc:1397] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 04:48:54.722522 27065 raft_consensus.cc:348] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.722640 27065 raft_consensus.cc:374] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:54.722681 27065 raft_consensus.cc:729] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de739099a8964769b80ba12970846520, State: Initialized, Role: FOLLOWER
I20260811 04:48:54.722798 27065 consensus_queue.cc:260] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.723019 27065 ts_tablet_manager.cc:1428] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:48:54.873903 27073 raft_consensus.cc:482] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:48:54.874043 27073 raft_consensus.cc:504] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.874468 27073 leader_election.cc:288] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.874989 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2085ce9ecd1940d69a495d3e8d13b8f4" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157" is_pre_election: true
I20260811 04:48:54.875008 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2085ce9ecd1940d69a495d3e8d13b8f4" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520" is_pre_election: true
I20260811 04:48:54.875154 26678 raft_consensus.cc:2454] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.875164 26816 raft_consensus.cc:2454] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 0.
I20260811 04:48:54.875464 26910 leader_election.cc:302] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: de739099a8964769b80ba12970846520, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.875659 27073 raft_consensus.cc:2781] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:48:54.875736 27073 raft_consensus.cc:482] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:48:54.875790 27073 raft_consensus.cc:3037] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.876780 27073 raft_consensus.cc:504] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.877079 27073 leader_election.cc:288] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Requested vote from peers 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977), de739099a8964769b80ba12970846520 (127.17.188.66:38265)
I20260811 04:48:54.877410 26678 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2085ce9ecd1940d69a495d3e8d13b8f4" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7dc41089b27a48fe8db2827c43fe1157"
I20260811 04:48:54.877478 26816 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2085ce9ecd1940d69a495d3e8d13b8f4" candidate_uuid: "f444fceb064049abb9f3208208440f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de739099a8964769b80ba12970846520"
I20260811 04:48:54.877521 26678 raft_consensus.cc:3037] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.877658 26816 raft_consensus.cc:3037] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:54.878515 26816 raft_consensus.cc:2454] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.878541 26678 raft_consensus.cc:2454] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f444fceb064049abb9f3208208440f11 in term 1.
I20260811 04:48:54.878813 26910 leader_election.cc:302] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7dc41089b27a48fe8db2827c43fe1157, f444fceb064049abb9f3208208440f11; no voters:
I20260811 04:48:54.878990 27073 raft_consensus.cc:2781] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:54.879099 27073 raft_consensus.cc:686] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 1 LEADER]: Becoming Leader. State: Replica: f444fceb064049abb9f3208208440f11, State: Running, Role: LEADER
I20260811 04:48:54.879248 27073 consensus_queue.cc:237] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } }
I20260811 04:48:54.881125 26503 catalog_manager.cc:5495] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to f444fceb064049abb9f3208208440f11 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "f444fceb064049abb9f3208208440f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f444fceb064049abb9f3208208440f11" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 39559 } health_report { overall_health: HEALTHY } } }
I20260811 04:48:54.922124 27063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.919477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:34189 (local address 127.17.188.67:39559)
0811 04:48:54.919597 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:54.919601 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:54.919670 (+ 69us) server_negotiation.cc:407] Connection header received
0811 04:48:54.919758 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:54.919760 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:54.919798 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:54.919861 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:48:54.920073 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.920538 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.921269 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.921452 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.921518 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.921787 (+ 269us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.921843 (+ 56us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.921895 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:54.921965 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 04:48:54.922003 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 04:48:54.922132 27153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.919387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:39559 (local address 127.17.188.67:34189)
0811 04:48:54.919597 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.919609 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:54.919693 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:54.919880 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:54.919882 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:54.919888 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 04:48:54.919984 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.919987 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.920623 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.920625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.921176 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:54.921182 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:54.921549 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:54.921552 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:54.921672 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:54.921694 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 04:48:54.921911 (+ 217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 04:48:54.921915 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:48:54.921959 (+ 44us) client_negotiation.cc:240] Negotiation successful
0811 04:48:54.922020 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260811 04:48:54.927035 26816 raft_consensus.cc:1261] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.927101 26678 raft_consensus.cc:1261] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Refusing update from remote peer f444fceb064049abb9f3208208440f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:48:54.927431 27109 consensus_queue.cc:1035] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de739099a8964769b80ba12970846520" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 38265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.927681 27073 consensus_queue.cc:1035] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7dc41089b27a48fe8db2827c43fe1157" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:48:54.957958 26501 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.958101 26501 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50702:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:48:54.960152 26501 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f3b9b3d807304b4883a4cf919029111a: Sending DeleteTablet for 3 replicas of tablet 2085ce9ecd1940d69a495d3e8d13b8f4
I20260811 04:48:54.960662 26657 tablet_service.cc:1514] Processing DeleteTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42302
I20260811 04:48:54.960757 26962 tablet_service.cc:1514] Processing DeleteTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:56658
I20260811 04:48:54.960821 26808 tablet_service.cc:1514] Processing DeleteTablet for tablet 2085ce9ecd1940d69a495d3e8d13b8f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:48:54 UTC) from {username='oryx', principal='oryx/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42112
I20260811 04:48:54.960877 27094 tablet_replica.cc:330] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157: stopping tablet replica
I20260811 04:48:54.961007 27094 raft_consensus.cc:2229] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.961124 27094 raft_consensus.cc:2258] T 2085ce9ecd1940d69a495d3e8d13b8f4 P 7dc41089b27a48fe8db2827c43fe1157 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.961133 27092 tablet_replica.cc:330] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: stopping tablet replica
I20260811 04:48:54.961249 27092 raft_consensus.cc:2229] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:48:54.961361 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26585
I20260811 04:48:54.961457 27092 raft_consensus.cc:2258] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.961645 27093 tablet_replica.cc:330] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: stopping tablet replica
I20260811 04:48:54.961771 27093 raft_consensus.cc:2229] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:48:54.961866 27093 raft_consensus.cc:2258] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:48:54.963420 27092 ts_tablet_manager.cc:1905] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.963775 27093 ts_tablet_manager.cc:1905] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:48:54.965662 27092 ts_tablet_manager.cc:1918] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:54.965683 27093 ts_tablet_manager.cc:1918] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 04:48:54.965747 27092 log.cc:1196] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/2085ce9ecd1940d69a495d3e8d13b8f4
I20260811 04:48:54.965754 27093 log.cc:1196] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/2085ce9ecd1940d69a495d3e8d13b8f4
I20260811 04:48:54.966017 27092 ts_tablet_manager.cc:1939] T 2085ce9ecd1940d69a495d3e8d13b8f4 P f444fceb064049abb9f3208208440f11: Deleting consensus metadata
I20260811 04:48:54.966048 27093 ts_tablet_manager.cc:1939] T 2085ce9ecd1940d69a495d3e8d13b8f4 P de739099a8964769b80ba12970846520: Deleting consensus metadata
I20260811 04:48:54.966650 26486 catalog_manager.cc:4841] TS de739099a8964769b80ba12970846520 (127.17.188.66:38265): tablet 2085ce9ecd1940d69a495d3e8d13b8f4 (table test-table [id=4a9af00a9c2e414c9135646cc0a60fab]) successfully deleted
I20260811 04:48:54.966707 26488 catalog_manager.cc:4841] TS f444fceb064049abb9f3208208440f11 (127.17.188.67:39559): tablet 2085ce9ecd1940d69a495d3e8d13b8f4 (table test-table [id=4a9af00a9c2e414c9135646cc0a60fab]) successfully deleted
W20260811 04:48:54.971781 26486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:37977 (error 108)
I20260811 04:48:54.972601 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26735
I20260811 04:48:54.974890 27160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:54.972434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37977 (local address 127.0.0.1:42326)
0811 04:48:54.972662 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:54.974765 (+ 2103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":74,"threads_started":1}
W20260811 04:48:54.974995 26486 catalog_manager.cc:4584] TS 7dc41089b27a48fe8db2827c43fe1157 (127.17.188.65:37977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2085ce9ecd1940d69a495d3e8d13b8f4: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37977: connect: Connection refused (error 111)
I20260811 04:48:54.980618 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26891
I20260811 04:48:54.989729 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 26468
2026-08-11T04:48:54Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3279 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:55 dist-test-slave-njxd krb5kdc[27163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:55 dist-test-slave-njxd krb5kdc[27163](info): set up 2 sockets
Aug 11 04:48:55 dist-test-slave-njxd krb5kdc[27163](info): commencing operation
krb5kdc: starting...
W20260811 04:48:56.073669 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:56 dist-test-slave-njxd krb5kdc[27163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:56.199836 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37913
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41179
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:37913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:56.311362 27176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:56.311646 27176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:56.311740 27176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:56.316349 27176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:56.316429 27176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:56.316466 27176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:56.316504 27176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:56.316537 27176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:56.321986 27176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41179
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:37913
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:37913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:56.323007 27176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:56.324005 27176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:56.332397 27182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:56.332379 27181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:56.332491 27176 server_base.cc:1034] running on GCE node
W20260811 04:48:56.332381 27184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:56.333179 27176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:56.334316 27176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:56.335486 27176 hybrid_clock.cc:648] HybridClock initialized: now 1786423736335474 us; error 29 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T04:48:56Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1355 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:48:56 dist-test-slave-njxd krb5kdc[27189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:48:56 dist-test-slave-njxd krb5kdc[27189](info): set up 2 sockets
Aug 11 04:48:56 dist-test-slave-njxd krb5kdc[27189](info): commencing operation
krb5kdc: starting...
W20260811 04:48:57.423208 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:48:57 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:48:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:48:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:48:57.552785 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36253
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:57.666978 27203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:57.667281 27203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:57.667358 27203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:57.671393 27203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:57.671480 27203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:57.671520 27203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:57.671584 27203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:57.671633 27203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:57.676815 27203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:57.677958 27203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:57.678995 27203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:57.687510 27208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:57.687572 27209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:57.687551 27211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:57.687793 27203 server_base.cc:1034] running on GCE node
I20260811 04:48:57.688444 27203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:57.689529 27203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:57.690744 27203 hybrid_clock.cc:648] HybridClock initialized: now 1786423737690726 us; error 29 us; skew 500 ppm
Aug 11 04:48:57 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:57.693374 27203 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:57.694258 27203 webserver.cc:460] Webserver started at http://127.17.188.126:45353/ using document root <none> and password file <none>
I20260811 04:48:57.694849 27203 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:57.694941 27203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:57.695181 27203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:57.697208 27203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "5081a6efb3d24fbab7e5b13bf54ce698"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "ea900a292de9646e46e7d917e71d7e30"
server_key_iv: "cbad5128df27065fddbe29cc67e1b63b"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.697854 27203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "5081a6efb3d24fbab7e5b13bf54ce698"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "ea900a292de9646e46e7d917e71d7e30"
server_key_iv: "cbad5128df27065fddbe29cc67e1b63b"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.701644 27203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260811 04:48:57.704041 27218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:57.705245 27203 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260811 04:48:57.705380 27203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "5081a6efb3d24fbab7e5b13bf54ce698"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "ea900a292de9646e46e7d917e71d7e30"
server_key_iv: "cbad5128df27065fddbe29cc67e1b63b"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.705492 27203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:57.730252 27203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:57.733316 27203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:57.733530 27203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:57.740862 27203 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36253
I20260811 04:48:57.740936 27275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36253 every 8 connection(s)
I20260811 04:48:57.741873 27203 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:57.744648 27276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:48:57.749825 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27203
I20260811 04:48:57.749966 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:48:57.750257 18161 external_mini_cluster.cc:1428] Setting key c0ba200307c34e446ccdf33dcd37541a
I20260811 04:48:57.750414 27276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Bootstrap starting.
I20260811 04:48:57.752980 27276 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Neither blocks nor log segments found. Creating new log.
I20260811 04:48:57.753974 27276 log.cc:824] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:57.756163 27276 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: No bootstrap required, opened a new log
Aug 11 04:48:57 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:57.760913 27276 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:57.761226 27276 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:48:57.761292 27276 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5081a6efb3d24fbab7e5b13bf54ce698, State: Initialized, Role: FOLLOWER
I20260811 04:48:57.761884 27276 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:57.762108 27276 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:57.762276 27276 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:57.762405 27276 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:48:57.763691 27276 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:57.764103 27276 leader_election.cc:302] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5081a6efb3d24fbab7e5b13bf54ce698; no voters:
I20260811 04:48:57.764508 27276 leader_election.cc:288] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:48:57.764637 27281 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:48:57.764901 27281 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 LEADER]: Becoming Leader. State: Replica: 5081a6efb3d24fbab7e5b13bf54ce698, State: Running, Role: LEADER
I20260811 04:48:57.765657 27279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:57.751617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.17.188.126:36253)
0811 04:48:57.752023 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:57.752040 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:57.752077 (+ 37us) server_negotiation.cc:407] Connection header received
0811 04:48:57.752704 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:57.752721 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:57.753042 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:57.753390 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:57.754376 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:57.755352 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:57.756485 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:57.756931 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:57.757046 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:57.759959 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:57.759966 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:57.759983 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:57.760018 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:57.761977 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:57.762593 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:57.762599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:57.762606 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:57.762763 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:57.763078 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:57.763082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:57.763084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:57.763689 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:57.763889 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:57.764178 (+ 289us) server_negotiation.cc:299] Negotiation successful
0811 04:48:57.764508 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":131,"threads_started":1}
I20260811 04:48:57.765787 27276 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:57.765974 27281 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:57.767786 27283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } } }
I20260811 04:48:57.768364 27283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:57.768157 27282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5081a6efb3d24fbab7e5b13bf54ce698. Latest consensus state: current_term: 1 leader_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } } }
I20260811 04:48:57.768723 27282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: This master's current role is: LEADER
W20260811 04:48:57.771006 27297 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:48:57.771138 27297 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:48:57.771262 27298 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:57.772217 27298 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:57.778080 27298 catalog_manager.cc:1347] Generated new cluster ID: 33c755aa7e8d433794342628ec3b6dbd
I20260811 04:48:57.778149 27298 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:57.791292 27298 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:48:57.792776 27298 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:57.808459 27298 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Generated new TSK 0
I20260811 04:48:57.809316 27298 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:48:57.850651 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:57.961539 27304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:57.961798 27304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:57.961836 27304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:57.965480 27304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:57.965523 27304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:57.965627 27304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:57.970825 27304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:57.971730 27304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:57.972649 27304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:57.982014 27309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:57.982146 27304 server_base.cc:1034] running on GCE node
W20260811 04:48:57.982020 27310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:57.982025 27312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:57.982622 27304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:57.983237 27304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:57.984426 27304 hybrid_clock.cc:648] HybridClock initialized: now 1786423737984407 us; error 31 us; skew 500 ppm
Aug 11 04:48:57 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:57.987223 27304 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:48:57.988098 27304 webserver.cc:460] Webserver started at http://127.17.188.65:33457/ using document root <none> and password file <none>
I20260811 04:48:57.988665 27304 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:57.988758 27304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:57.989001 27304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:57.991040 27304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "c815f4c27f3f456f92d06bfce1bfac01"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "7248845d3a30c93b02751e09c315ba67"
server_key_iv: "9b45ba8d3491cb63ab97b3c245970fa7"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.991595 27304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "c815f4c27f3f456f92d06bfce1bfac01"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "7248845d3a30c93b02751e09c315ba67"
server_key_iv: "9b45ba8d3491cb63ab97b3c245970fa7"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.995258 27304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 04:48:57.997713 27323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:57.998914 27304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:57.999043 27304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "c815f4c27f3f456f92d06bfce1bfac01"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "7248845d3a30c93b02751e09c315ba67"
server_key_iv: "9b45ba8d3491cb63ab97b3c245970fa7"
server_key_version: "encryptionkey@0"
I20260811 04:48:57.999145 27304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:58.012004 27304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:58.014884 27304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:58.015084 27304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:58.015667 27304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:58.016448 27304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:58.016517 27304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.016598 27304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:58.016649 27304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.025842 27304 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:41013
I20260811 04:48:58.025869 27444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:41013 every 8 connection(s)
I20260811 04:48:58.026757 27304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:58.027148 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27304
I20260811 04:48:58.027309 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:48:58.027647 18161 external_mini_cluster.cc:1428] Setting key 5862ae77101ae311285f3423e93f904d
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423737, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:48:58.041064 27279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.028538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:41007 (local address 127.17.188.126:36253)
0811 04:48:58.028711 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:58.028716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:58.029964 (+ 1248us) server_negotiation.cc:407] Connection header received
0811 04:48:58.031312 (+ 1348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:58.031317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:58.031382 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:58.031491 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:58.032639 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.033179 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.034483 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.034746 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.034868 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.037377 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:58.037381 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:58.037385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:58.037415 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:58.038992 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.039508 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.039512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.039514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.039600 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.039963 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.039967 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.039969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.040158 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:58.040267 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:58.040751 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 04:48:58.040882 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 04:48:58.042114 27447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.028945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:41007)
0811 04:48:58.029798 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:58.029859 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:58.031067 (+ 1208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:58.031670 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:58.031676 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:58.032016 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:58.032479 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.032492 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.033321 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.033325 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.034354 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.034364 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.034908 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.034913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.035080 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.035725 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:58.035741 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:58.037208 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:58.039122 (+ 1914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.039128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.039143 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.039399 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.039697 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.039701 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.039703 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.039846 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.040268 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:58.040275 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:58.040513 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 04:48:58.040710 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 04:48:58.041025 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":136,"threads_started":1}
I20260811 04:48:58.043431 27445 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36253
I20260811 04:48:58.043700 27445 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:58.044332 27445 heartbeater.cc:511] Master 127.17.188.126:36253 requested a full tablet report, sending...
I20260811 04:48:58.046083 27236 ts_manager.cc:194] Registered new tserver with Master: c815f4c27f3f456f92d06bfce1bfac01 (127.17.188.65:41013)
I20260811 04:48:58.047827 27236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:41007
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:48:58.058602 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:58.170164 27450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:58.170454 27450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:58.170507 27450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:58.174520 27450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:58.174597 27450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:58.174654 27450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:58.179935 27450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:58.180928 27450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:58.181952 27450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:58.191596 27456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.191617 27459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.191615 27457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:58.192024 27450 server_base.cc:1034] running on GCE node
I20260811 04:48:58.192430 27450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:58.193090 27450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:58.194289 27450 hybrid_clock.cc:648] HybridClock initialized: now 1786423738194257 us; error 44 us; skew 500 ppm
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:58.202450 27450 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:48:58.203444 27450 webserver.cc:460] Webserver started at http://127.17.188.66:42095/ using document root <none> and password file <none>
I20260811 04:48:58.204034 27450 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:58.204138 27450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:58.204382 27450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:58.206548 27450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "256e10fba75b40bfa8217af777bac469"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "490afe77ce6a86690691bc73643c7381"
server_key_iv: "28b0cb9a5485c3000ee76e61373c0651"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.207134 27450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "256e10fba75b40bfa8217af777bac469"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "490afe77ce6a86690691bc73643c7381"
server_key_iv: "28b0cb9a5485c3000ee76e61373c0651"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.211105 27450 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 04:48:58.213531 27466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.214905 27450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:48:58.215052 27450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "256e10fba75b40bfa8217af777bac469"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "490afe77ce6a86690691bc73643c7381"
server_key_iv: "28b0cb9a5485c3000ee76e61373c0651"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.215178 27450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:58.246122 27450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:58.249720 27450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:58.249948 27450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:58.250607 27450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:58.251485 27450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:58.251567 27450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.251642 27450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:58.251688 27450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.261179 27450 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38793
I20260811 04:48:58.261206 27589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38793 every 8 connection(s)
I20260811 04:48:58.262187 27450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:58.266541 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27450
I20260811 04:48:58.266671 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:48:58.267091 18161 external_mini_cluster.cc:1428] Setting key 6320d45de440ac432cbb96594e1659ab
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:48:58.277382 27279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.263991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:41133 (local address 127.17.188.126:36253)
0811 04:48:58.264139 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:58.264143 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:58.265246 (+ 1103us) server_negotiation.cc:407] Connection header received
0811 04:48:58.266224 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:58.266227 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:58.266307 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:58.266423 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:58.268008 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.268769 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.270483 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.270829 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.270939 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.273719 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:58.273722 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:58.273724 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:58.273747 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:58.275253 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.275804 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.275808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.275809 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.275886 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.276242 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.276245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.276247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.276430 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:58.276540 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:58.277054 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 04:48:58.277193 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:48:58.278371 27592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.264367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:41133)
0811 04:48:58.265091 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:58.265143 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:58.266015 (+ 872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:58.266571 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:58.266577 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:58.267226 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:58.267815 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.267852 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.268899 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.268903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.270361 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.270376 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.271081 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.271084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.271232 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.271834 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:58.271850 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:58.273521 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:58.275394 (+ 1873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.275401 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.275416 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.275684 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.275981 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.275985 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.275987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.276137 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.276539 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:58.276547 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:58.276804 (+ 257us) client_negotiation.cc:769] Sending connection context
0811 04:48:58.276994 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 04:48:58.277333 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":137,"threads_started":1}
I20260811 04:48:58.279603 27590 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36253
I20260811 04:48:58.279889 27590 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:48:58.280474 27590 heartbeater.cc:511] Master 127.17.188.126:36253 requested a full tablet report, sending...
I20260811 04:48:58.281982 27236 ts_manager.cc:194] Registered new tserver with Master: 256e10fba75b40bfa8217af777bac469 (127.17.188.66:38793)
I20260811 04:48:58.282567 27236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:41133
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:48:58.296852 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:58.412549 27595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:58.412873 27595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:58.412952 27595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:58.416852 27595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:58.416904 27595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:58.416958 27595 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:58.422139 27595 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27595
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:58.423163 27595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:58.424129 27595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:58.433899 27602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.433912 27605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.433957 27603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:58.434116 27595 server_base.cc:1034] running on GCE node
I20260811 04:48:58.434620 27595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:58.435282 27595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:58.436478 27595 hybrid_clock.cc:648] HybridClock initialized: now 1786423738436446 us; error 44 us; skew 500 ppm
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:58.439381 27595 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:48:58.440284 27595 webserver.cc:460] Webserver started at http://127.17.188.67:36071/ using document root <none> and password file <none>
I20260811 04:48:58.440855 27595 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:58.440946 27595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:58.441190 27595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:48:58.443315 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "daa63a57eab04f8bb56ccd1be3e740db"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "49d8ffe3c751862028abb83d6a046827"
server_key_iv: "5d11a4036c3ea270ad9e9ffbf17df7de"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.443888 27595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "daa63a57eab04f8bb56ccd1be3e740db"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "49d8ffe3c751862028abb83d6a046827"
server_key_iv: "5d11a4036c3ea270ad9e9ffbf17df7de"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.447639 27595 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:48:58.450053 27612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.451217 27595 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:58.451352 27595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "daa63a57eab04f8bb56ccd1be3e740db"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "49d8ffe3c751862028abb83d6a046827"
server_key_iv: "5d11a4036c3ea270ad9e9ffbf17df7de"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.451459 27595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:58.465837 27595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:58.469298 27595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:58.469523 27595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:58.470199 27595 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:58.471071 27595 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:58.471145 27595 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.471216 27595 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:58.471266 27595 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.480243 27595 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:40101
I20260811 04:48:58.480274 27738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:40101 every 8 connection(s)
I20260811 04:48:58.481132 27595 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:58.484441 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27595
I20260811 04:48:58.484635 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:48:58.484953 18161 external_mini_cluster.cc:1428] Setting key 63f2d5c9ed7bac0a02819217402e420d
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:48:58.494807 27279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.483057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:33109 (local address 127.17.188.126:36253)
0811 04:48:58.483207 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:58.483211 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:58.484239 (+ 1028us) server_negotiation.cc:407] Connection header received
0811 04:48:58.485314 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:58.485317 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:58.485373 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:58.485480 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:58.486873 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.487417 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.488557 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.488782 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.488895 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.491387 (+ 2492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:58.491391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:58.491393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:58.491425 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:58.492686 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.493200 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.493203 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.493205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.493290 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:58.493700 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:58.493703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:58.493705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:58.493887 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:58.493998 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:58.494499 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 04:48:58.494639 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:48:58.495633 27742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.483443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:33109)
0811 04:48:58.484090 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:58.484131 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:58.485110 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:58.485705 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:58.485714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:58.486100 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:58.486703 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.486718 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.487547 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.487555 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.488430 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:58.488440 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:58.488932 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:58.488936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:58.489106 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:58.489778 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:58.489794 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:58.491231 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:48:58.492802 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.492808 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.492824 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.493086 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.493392 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:48:58.493395 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:48:58.493397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:48:58.493551 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:48:58.493995 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:48:58.494002 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:48:58.494248 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 04:48:58.494441 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 04:48:58.494793 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":108,"threads_started":1}
I20260811 04:48:58.496847 27739 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36253
I20260811 04:48:58.497120 27739 heartbeater.cc:464] Registering TS with master...
I20260811 04:48:58.497784 27739 heartbeater.cc:511] Master 127.17.188.126:36253 requested a full tablet report, sending...
I20260811 04:48:58.499004 27235 ts_manager.cc:194] Registered new tserver with Master: daa63a57eab04f8bb56ccd1be3e740db (127.17.188.67:40101)
I20260811 04:48:58.499653 27235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:33109
I20260811 04:48:58.511180 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
Entry for principal oryx/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab.
WARNING: no policy specified for oryx/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
Entry for principal oryx/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab.
WARNING: no policy specified for oryx/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
Entry for principal oryx/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab.
I20260811 04:48:58.590397 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27304
I20260811 04:48:58.598444 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27450
I20260811 04:48:58.605473 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27595
I20260811 04:48:58.611882 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27203
I20260811 04:48:58.620671 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36253
--webserver_interface=127.17.188.126
--webserver_port=45353
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:48:58.735224 27749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:58.735492 27749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:58.735533 27749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:58.739490 27749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:48:58.739555 27749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:58.739575 27749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:58.739593 27749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:48:58.739612 27749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:48:58.745168 27749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=45353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:58.746258 27749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:58.747354 27749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:58.756203 27756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.756243 27755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.756247 27759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:58.756615 27749 server_base.cc:1034] running on GCE node
I20260811 04:48:58.757182 27749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:58.758328 27749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:58.759526 27749 hybrid_clock.cc:648] HybridClock initialized: now 1786423738759481 us; error 61 us; skew 500 ppm
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:58.762348 27749 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:48:58.763298 27749 webserver.cc:460] Webserver started at http://127.17.188.126:45353/ using document root <none> and password file <none>
I20260811 04:48:58.763880 27749 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:58.763998 27749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:58.767922 27749 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:48:58.770253 27766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.771559 27749 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:48:58.771718 27749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "5081a6efb3d24fbab7e5b13bf54ce698"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "ea900a292de9646e46e7d917e71d7e30"
server_key_iv: "cbad5128df27065fddbe29cc67e1b63b"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.772277 27749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:58.791584 27749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:58.794624 27749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:58.794834 27749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:58.802214 27749 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36253
I20260811 04:48:58.802234 27821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36253 every 8 connection(s)
I20260811 04:48:58.803241 27749 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:48:58.807440 27822 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:48:58.807634 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27749
I20260811 04:48:58.808066 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:41013
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:36253
--webserver_port=33457
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:48:58.809196 27822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Bootstrap starting.
I20260811 04:48:58.826352 27822 log.cc:824] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Log is configured to *not* fsync() on all Append() calls
I20260811 04:48:58.833108 27822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:48:58.833518 27822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Bootstrap complete.
I20260811 04:48:58.837895 27822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:58.838364 27822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5081a6efb3d24fbab7e5b13bf54ce698, State: Initialized, Role: FOLLOWER
I20260811 04:48:58.838858 27822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:58.839008 27822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:48:58.839100 27822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:48:58.839228 27822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:48:58.841243 27822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:58.841563 27822 leader_election.cc:302] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5081a6efb3d24fbab7e5b13bf54ce698; no voters:
I20260811 04:48:58.841960 27822 leader_election.cc:288] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 04:48:58.842052 27826 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 04:48:58.842289 27826 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [term 2 LEADER]: Becoming Leader. State: Replica: 5081a6efb3d24fbab7e5b13bf54ce698, State: Running, Role: LEADER
I20260811 04:48:58.842646 27826 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } }
I20260811 04:48:58.843233 27822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:48:58.843554 27826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5081a6efb3d24fbab7e5b13bf54ce698. Latest consensus state: current_term: 2 leader_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } } }
I20260811 04:48:58.843680 27826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:58.844310 27828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5081a6efb3d24fbab7e5b13bf54ce698" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36253 } } }
I20260811 04:48:58.844410 27828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698 [sys.catalog]: This master's current role is: LEADER
I20260811 04:48:58.844934 27833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:48:58.848150 27833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:48:58.848853 27833 catalog_manager.cc:1259] Loaded cluster ID: 33c755aa7e8d433794342628ec3b6dbd
I20260811 04:48:58.848918 27833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:48:58.851313 27833 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:48:58.851949 27833 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 5081a6efb3d24fbab7e5b13bf54ce698: Loaded TSK: 0
I20260811 04:48:58.853156 27833 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:48:58.923550 27824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:58.923832 27824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:58.923918 27824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:58.928454 27824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:58.928521 27824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:58.928612 27824 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:48:58.933861 27824 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.65.keytab
--principal=oryx/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:41013
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=33457
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:58.934985 27824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:58.936015 27824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:58.945745 27855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:58.945739 27854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:58.945809 27824 server_base.cc:1034] running on GCE node
W20260811 04:48:58.945739 27857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:58.946327 27824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:58.946980 27824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:58.948194 27824 hybrid_clock.cc:648] HybridClock initialized: now 1786423738948158 us; error 53 us; skew 500 ppm
Aug 11 04:48:58 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423738, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:58.951205 27824 init.cc:377] Logged in from keytab as oryx/127.17.188.65@KRBTEST.COM (short username oryx)
I20260811 04:48:58.952242 27824 webserver.cc:460] Webserver started at http://127.17.188.65:33457/ using document root <none> and password file <none>
I20260811 04:48:58.952860 27824 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:58.952939 27824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:58.956955 27824 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:48:58.959079 27866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.960348 27824 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:58.960469 27824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "c815f4c27f3f456f92d06bfce1bfac01"
format_stamp: "Formatted at 2026-08-11 04:48:57 on dist-test-slave-njxd"
server_key: "7248845d3a30c93b02751e09c315ba67"
server_key_iv: "9b45ba8d3491cb63ab97b3c245970fa7"
server_key_version: "encryptionkey@0"
I20260811 04:48:58.960979 27824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:58.982257 27824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:58.985450 27824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:58.985638 27824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:58.986233 27824 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:58.987044 27824 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:58.987092 27824 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.987169 27824 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:58.987200 27824 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:58.996142 27824 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:41013
I20260811 04:48:58.996169 27988 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:41013 every 8 connection(s)
I20260811 04:48:58.997159 27824 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:48:59.005725 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27824
I20260811 04:48:59.006172 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:38793
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:36253
--webserver_port=42095
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.010301 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:58.999470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:53059)
0811 04:48:59.000175 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.000216 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.001027 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.002176 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.002183 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.002613 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.003094 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.003108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.004400 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.004410 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.005254 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.005262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.006145 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.006149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.006339 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.006954 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.006970 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.009339 (+ 2369us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":133,"threads_started":1}
W20260811 04:48:59.010295 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:58.999365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:53059 (local address 127.17.188.126:36253)
0811 04:48:58.999928 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:58.999950 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.000342 (+ 392us) server_negotiation.cc:407] Connection header received
0811 04:48:59.001447 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.001458 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.001772 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.002098 (+ 326us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.003280 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.004254 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.005383 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.005979 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.006179 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.009548 (+ 3369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:53059: BlockingRecv error: recv got EOF from 127.17.188.65:53059 (error 108)
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":151,"threads_started":1}
W20260811 04:48:59.010907 27989 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36253 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.188.126:36253: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.016558 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.011378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:51109)
0811 04:48:59.011474 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.011488 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.011568 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.011818 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.011821 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.011982 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.012065 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.012070 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.012787 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.012792 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.013316 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.013323 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.013856 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.013860 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.013957 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.014442 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.014453 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.016376 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 04:48:59.016585 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.011479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:51109 (local address 127.17.188.126:36253)
0811 04:48:59.011621 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.011627 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.011640 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:59.011673 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.011675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.011721 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.011804 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.012181 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.012679 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.013436 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.013739 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.013843 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.016498 (+ 2655us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:51109: BlockingRecv error: recv got EOF from 127.17.188.65:51109 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.022549 27993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.017148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:50079)
0811 04:48:59.017295 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.017312 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.017406 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.017721 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.017724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.017890 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.017979 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.017986 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.018669 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.018672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.019517 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.019526 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.019956 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.019959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.020044 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.020485 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.020500 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.022390 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 04:48:59.022765 27989 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 04:48:59.022797 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.017262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:50079 (local address 127.17.188.126:36253)
0811 04:48:59.017362 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.017366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.017387 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:48:59.017503 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.017505 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.017543 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.017699 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.018096 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.018571 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.019632 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.019851 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.019921 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.022591 (+ 2670us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:50079: BlockingRecv error: recv got EOF from 127.17.188.65:50079 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260811 04:48:59.124017 27994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:59.124318 27994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:59.124399 27994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:59.128677 27994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:59.128762 27994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:59.128855 27994 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:48:59.134172 27994 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.66.keytab
--principal=oryx/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:38793
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=42095
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:59.135306 27994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:59.136366 27994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:59.146154 28004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:59.146132 28000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:59.146128 28001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:59.146524 27994 server_base.cc:1034] running on GCE node
I20260811 04:48:59.146966 27994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:59.147589 27994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:59.148756 27994 hybrid_clock.cc:648] HybridClock initialized: now 1786423739148746 us; error 27 us; skew 500 ppm
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423739, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:59.151585 27994 init.cc:377] Logged in from keytab as oryx/127.17.188.66@KRBTEST.COM (short username oryx)
I20260811 04:48:59.152457 27994 webserver.cc:460] Webserver started at http://127.17.188.66:42095/ using document root <none> and password file <none>
I20260811 04:48:59.153121 27994 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:59.153219 27994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:59.156986 27994 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.002s
I20260811 04:48:59.159103 28013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.160317 27994 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:48:59.160439 27994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "256e10fba75b40bfa8217af777bac469"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "490afe77ce6a86690691bc73643c7381"
server_key_iv: "28b0cb9a5485c3000ee76e61373c0651"
server_key_version: "encryptionkey@0"
I20260811 04:48:59.160943 27994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:59.175980 27994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:59.179014 27994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:59.179219 27994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:59.179800 27994 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:59.180608 27994 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:59.180656 27994 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.180719 27994 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:59.180760 27994 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.189765 27994 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:38793
I20260811 04:48:59.189787 28136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:38793 every 8 connection(s)
I20260811 04:48:59.190687 27994 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:48:59.193426 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 27994
I20260811 04:48:59.193902 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:40101
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:36253
--webserver_port=36071
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 04:48:59.202034 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.192454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:40759 (local address 127.17.188.126:36253)
0811 04:48:59.192593 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.192597 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.193386 (+ 789us) server_negotiation.cc:407] Connection header received
0811 04:48:59.194862 (+ 1476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.194866 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.194931 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.195038 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.196226 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.196764 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.197976 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.198206 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.198321 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.201845 (+ 3524us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:40759: BlockingRecv error: recv got EOF from 127.17.188.66:40759 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:48:59.202523 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.192817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:40759)
0811 04:48:59.193241 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.193284 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.194648 (+ 1364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.195219 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.195227 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.195620 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.196077 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.196090 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.196901 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.196905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.197839 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.197850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.198361 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.198366 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.198537 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.199157 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.199172 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.201709 (+ 2537us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":110,"threads_started":1}
W20260811 04:48:59.203255 28137 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36253 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.188.126:36253: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.208670 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.203718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:37511)
0811 04:48:59.203814 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.203830 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.203930 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.204184 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.204187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.204345 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.204433 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.204438 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.205183 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.205186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.205773 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.205782 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.206224 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.206227 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.206317 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.206804 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.206815 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.208582 (+ 1767us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 04:48:59.208858 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.203828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:37511 (local address 127.17.188.126:36253)
0811 04:48:59.203972 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.203978 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.203994 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:59.204041 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.204043 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.204077 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.204169 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.204549 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.205057 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.205895 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.206116 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.206222 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.208748 (+ 2526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:37511: BlockingRecv error: recv got EOF from 127.17.188.66:37511 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.214201 28139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.209284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:34315)
0811 04:48:59.209397 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.209410 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.209480 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.209739 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.209741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.209858 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.209924 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.209928 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.210899 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.210901 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.211377 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.211384 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.211937 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.211939 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.211993 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.212426 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.212437 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.214123 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 04:48:59.214377 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.209350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:34315 (local address 127.17.188.126:36253)
0811 04:48:59.209447 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.209451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.209466 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:48:59.209563 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.209566 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.209629 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.209710 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.210024 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.210798 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.211490 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.211833 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.211931 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.214275 (+ 2344us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:34315: BlockingRecv error: recv got EOF from 127.17.188.66:34315 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 04:48:59.214426 28137 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 04:48:59.308956 28140 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:48:59.309211 28140 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:48:59.309252 28140 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:48:59.313383 28140 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:48:59.313452 28140 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:48:59.313511 28140 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:48:59.318727 28140 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/krb5kdc/oryx_127.17.188.67.keytab
--principal=oryx/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:40101
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=36071
--tserver_master_addrs=127.17.188.126:36253
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28140
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:48:59.319762 28140 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:48:59.320864 28140 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:48:59.330325 28149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:59.330390 28145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:48:59.330346 28146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:48:59.330669 28140 server_base.cc:1034] running on GCE node
I20260811 04:48:59.331091 28140 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:48:59.331766 28140 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:48:59.332954 28140 hybrid_clock.cc:648] HybridClock initialized: now 1786423739332942 us; error 24 us; skew 500 ppm
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423739, etypes {rep=17 tkt=17 ses=17}, oryx/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:48:59.335937 28140 init.cc:377] Logged in from keytab as oryx/127.17.188.67@KRBTEST.COM (short username oryx)
I20260811 04:48:59.336894 28140 webserver.cc:460] Webserver started at http://127.17.188.67:36071/ using document root <none> and password file <none>
I20260811 04:48:59.337469 28140 fs_manager.cc:359] Metadata directory not provided
I20260811 04:48:59.337580 28140 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:48:59.341536 28140 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.002s
I20260811 04:48:59.343799 28157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.345127 28140 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:48:59.345248 28140 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "daa63a57eab04f8bb56ccd1be3e740db"
format_stamp: "Formatted at 2026-08-11 04:48:58 on dist-test-slave-njxd"
server_key: "49d8ffe3c751862028abb83d6a046827"
server_key_iv: "5d11a4036c3ea270ad9e9ffbf17df7de"
server_key_version: "encryptionkey@0"
I20260811 04:48:59.345860 28140 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:48:59.365049 28140 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:48:59.368119 28140 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:48:59.368330 28140 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:48:59.368889 28140 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:48:59.369807 28140 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:48:59.369856 28140 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.369896 28140 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:48:59.369917 28140 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:48:59.378749 28140 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:40101
I20260811 04:48:59.378815 28283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:40101 every 8 connection(s)
I20260811 04:48:59.379774 28140 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:48:59.381242 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28140
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
W20260811 04:48:59.391134 27991 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.381626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:40499 (local address 127.17.188.126:36253)
0811 04:48:59.381747 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.381750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.383071 (+ 1321us) server_negotiation.cc:407] Connection header received
0811 04:48:59.384151 (+ 1080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.384154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.384227 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.384303 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.385396 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.386092 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.387185 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.387529 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.387666 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.391036 (+ 3370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:40499: BlockingRecv error: recv got EOF from 127.17.188.67:40499 (error 108)
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":32}
I20260811 04:48:59.391396 28287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.382207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57910 (local address 127.17.188.126:36253)
0811 04:48:59.382485 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.382489 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.382505 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:48:59.382555 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.382558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.382615 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.382713 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.383665 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.384231 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.385155 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.385390 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.385502 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.386943 (+ 1441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:48:59.386949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:48:59.386961 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:48:59.386987 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:48:59.388843 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:59.389290 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:59.389297 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:59.389303 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:59.389464 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:48:59.389803 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:48:59.389806 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:48:59.389808 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:48:59.390228 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:48:59.390371 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 04:48:59.390706 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 04:48:59.391299 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":96,"threads_started":1}
I20260811 04:48:59.391788 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.382142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:40499)
0811 04:48:59.382907 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.382964 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.383946 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.384468 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.384475 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.384808 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.385257 (+ 449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.385270 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.386215 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.386224 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.387060 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.387068 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.387715 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.387720 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.387879 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.388345 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.388360 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.390877 (+ 2517us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":148,"threads_started":1}
W20260811 04:48:59.392575 28284 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36253 (0 consecutive failures): Not authorized: Failed to ping master at 127.17.188.126:36253: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.397965 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.392990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:54721)
0811 04:48:59.393308 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.393324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.393406 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.393697 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.393700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.393861 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.393952 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.393957 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.394729 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.394732 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.395256 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.395263 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.395652 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.395655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.395722 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.396180 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.396192 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.397875 (+ 1683us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125}
W20260811 04:48:59.398236 28287 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.393097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:54721 (local address 127.17.188.126:36253)
0811 04:48:59.393225 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.393229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.393395 (+ 166us) server_negotiation.cc:407] Connection header received
0811 04:48:59.393506 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.393508 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.393550 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.393652 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.394085 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.394630 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.395354 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.395558 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.395628 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.398000 (+ 2372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:54721: BlockingRecv error: recv got EOF from 127.17.188.67:54721 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:48:59 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:48:59.402611 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:48:59.398526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:41793)
0811 04:48:59.398627 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 04:48:59.398640 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:48:59.398706 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:48:59.398887 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:48:59.398889 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:48:59.399015 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:48:59.399081 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.399085 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.399701 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.399703 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.400192 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:48:59.400199 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.400561 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.400563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:48:59.400616 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.400957 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:48:59.400967 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:48:59.402526 (+ 1559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 04:48:59.402737 28287 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:48:59.398574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:41793 (local address 127.17.188.126:36253)
0811 04:48:59.398716 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:48:59.398719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:48:59.398732 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:48:59.398762 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:48:59.398764 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:48:59.398794 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:48:59.398857 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:48:59.399173 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.399604 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.400284 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:48:59.400467 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:48:59.400535 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:48:59.402641 (+ 2106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:41793: BlockingRecv error: recv got EOF from 127.17.188.67:41793 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 04:48:59.402906 28284 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:00.029072 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:00.023409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:48851)
0811 04:49:00.023678 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:00.023692 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:00.023783 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:00.024025 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:00.024026 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:00.024202 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:00.024325 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.024329 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.025033 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.025035 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.025811 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.025825 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.026453 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.026459 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.026561 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.027116 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:00.027127 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:00.028967 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
W20260811 04:49:00.029232 28291 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:00.023481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:48851 (local address 127.17.188.126:36253)
0811 04:49:00.023758 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:00.023762 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:00.023774 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:49:00.023872 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:00.023874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:00.023917 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:00.023990 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:00.024428 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.024943 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.025939 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.026318 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.026411 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.029100 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:48851: BlockingRecv error: recv got EOF from 127.17.188.65:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":106,"threads_started":1}
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:00.221047 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:00.215207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:42641)
0811 04:49:00.215483 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:00.215496 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:00.215596 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:00.215851 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:00.215853 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:00.216031 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:00.216129 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.216135 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.216894 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.216896 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.217472 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.217480 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.217957 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.217960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.218024 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.218601 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:00.218629 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:00.220867 (+ 2238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
W20260811 04:49:00.221146 28291 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:00.215352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:42641 (local address 127.17.188.126:36253)
0811 04:49:00.215541 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:00.215545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:00.215561 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:49:00.215695 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:00.215697 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:00.215743 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:00.215813 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:00.216246 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.216788 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.217618 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.217845 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.217928 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.221007 (+ 3079us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:42641: BlockingRecv error: recv got EOF from 127.17.188.66:42641 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:00 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:00.409459 28294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:00.403591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:56813)
0811 04:49:00.403883 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:00.403896 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:00.403999 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:00.404322 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:00.404358 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:00.404622 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:00.404747 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.404753 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.405789 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.405792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.406363 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:00.406371 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.406794 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.406797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:00.406877 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.407353 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:00.407365 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:00.409290 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":72,"threads_started":1}
W20260811 04:49:00.409518 28291 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:00.403687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56813 (local address 127.17.188.126:36253)
0811 04:49:00.403881 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:00.403893 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:00.403972 (+ 79us) server_negotiation.cc:407] Connection header received
0811 04:49:00.404084 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:00.404088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:00.404170 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:00.404262 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:00.404871 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.405671 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.406476 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:00.406697 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:00.406774 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:00.409409 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:56813: BlockingRecv error: recv got EOF from 127.17.188.67:56813 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:01.035617 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:01.029897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:60497)
0811 04:49:01.030171 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:01.030184 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:01.030272 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:01.030624 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:01.030627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:01.030864 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:01.030968 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.030975 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.031738 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.031741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.032374 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.032382 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.032821 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.032823 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.032883 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.033477 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:01.033489 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:01.035481 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":92,"threads_started":1}
W20260811 04:49:01.035755 28297 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:01.029951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:60497 (local address 127.17.188.126:36253)
0811 04:49:01.030216 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:01.030220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:01.030233 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:49:01.030356 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:01.030358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:01.030412 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:01.030517 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:01.031085 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.031641 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.032481 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.032718 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.032801 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.035626 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:60497: BlockingRecv error: recv got EOF from 127.17.188.65:60497 (error 108)
Metrics: {"server-negotiator.queue_time_us":192,"thread_start_us":124,"threads_started":1}
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:01.227313 28298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:01.221814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:56681)
0811 04:49:01.222100 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:01.222118 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:01.222231 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:01.222443 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:01.222445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:01.222624 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:01.222719 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.222724 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.223427 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.223429 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.224119 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.224131 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.224643 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.224646 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.224759 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.225313 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:01.225324 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:01.227185 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":103,"threads_started":1}
W20260811 04:49:01.227460 28297 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:01.221958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:56681 (local address 127.17.188.126:36253)
0811 04:49:01.222097 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:01.222101 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:01.222186 (+ 85us) server_negotiation.cc:407] Connection header received
0811 04:49:01.222298 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:01.222300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:01.222339 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:01.222404 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:01.222820 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.223321 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.224242 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.224510 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.224639 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.227313 (+ 2674us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:56681: BlockingRecv error: recv got EOF from 127.17.188.66:56681 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:01 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:01.415508 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:01.410346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:43233)
0811 04:49:01.410629 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:01.410642 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:01.410738 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:01.410971 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:01.410973 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:01.411151 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:01.411247 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.411252 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.411978 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.411980 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.412514 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:01.412520 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.412985 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.412988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:01.413051 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.413541 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:01.413553 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:01.415393 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":97,"threads_started":1}
W20260811 04:49:01.415681 28297 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:01.410487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:43233 (local address 127.17.188.126:36253)
0811 04:49:01.410630 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:01.410634 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:01.410709 (+ 75us) server_negotiation.cc:407] Connection header received
0811 04:49:01.410816 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:01.410818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:01.410863 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:01.410929 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:01.411349 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.411887 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.412654 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:01.412886 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:01.412963 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:01.415529 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:43233: BlockingRecv error: recv got EOF from 127.17.188.67:43233 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:02.041903 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:02.036412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:51259)
0811 04:49:02.036842 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:02.036856 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:02.036957 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:02.037183 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:02.037185 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:02.037354 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:02.037449 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.037454 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.038229 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.038232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.038821 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.038831 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.039242 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.039244 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.039305 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.039773 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:02.039785 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:02.041716 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":85,"threads_started":1}
W20260811 04:49:02.041975 28301 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:02.036525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:51259 (local address 127.17.188.126:36253)
0811 04:49:02.036852 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:02.036856 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:02.036912 (+ 56us) server_negotiation.cc:407] Connection header received
0811 04:49:02.037024 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:02.037026 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:02.037070 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:02.037144 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:02.037588 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.038134 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.038928 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.039145 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.039219 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.041843 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:51259: BlockingRecv error: recv got EOF from 127.17.188.65:51259 (error 108)
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":96,"threads_started":1}
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:02.233981 28302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:02.228126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:44741)
0811 04:49:02.228441 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:02.228458 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:02.228600 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:02.228888 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:02.228891 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:02.229177 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:02.229340 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.229362 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.230188 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.230192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.230751 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.230759 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.231228 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.231231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.231317 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.231870 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:02.231890 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:02.233859 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":97,"threads_started":1}
W20260811 04:49:02.234172 28301 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:02.228190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44741 (local address 127.17.188.126:36253)
0811 04:49:02.228361 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:02.228366 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:02.228654 (+ 288us) server_negotiation.cc:407] Connection header received
0811 04:49:02.228710 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:02.228716 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:02.228775 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:02.228864 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:02.229477 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.230078 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.230873 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.231112 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.231222 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.234005 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:44741: BlockingRecv error: recv got EOF from 127.17.188.66:44741 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:02 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:02.422241 28303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:02.416350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:33183)
0811 04:49:02.416678 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:02.416700 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:02.416856 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:02.417128 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:02.417131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:02.417347 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:02.417441 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.417447 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.418353 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.418360 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.418948 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:02.418956 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.419435 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.419438 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:02.419526 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.420026 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:02.420038 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:02.422058 (+ 2020us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":89,"threads_started":1}
W20260811 04:49:02.422292 28301 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:02.416472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:33183 (local address 127.17.188.126:36253)
0811 04:49:02.416632 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:02.416637 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:02.416793 (+ 156us) server_negotiation.cc:407] Connection header received
0811 04:49:02.416956 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:02.416959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:02.417018 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:02.417119 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:02.417564 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.418241 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.419072 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:02.419311 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:02.419432 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:02.422182 (+ 2750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:33183: BlockingRecv error: recv got EOF from 127.17.188.67:33183 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:03.048298 28305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:03.042837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:60041)
0811 04:49:03.043148 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:03.043161 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:03.043255 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:03.043491 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:03.043493 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:03.043688 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:03.043832 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.043839 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.044663 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.044666 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.045246 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.045290 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.045767 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.045769 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.045834 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.046305 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:03.046316 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:03.048180 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":94,"threads_started":1}
W20260811 04:49:03.048499 28306 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:03.042886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:60041 (local address 127.17.188.126:36253)
0811 04:49:03.043151 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:03.043154 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:03.043206 (+ 52us) server_negotiation.cc:407] Connection header received
0811 04:49:03.043335 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:03.043337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:03.043380 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:03.043456 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:03.043934 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.044540 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.045392 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.045669 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.045747 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.048316 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:60041: BlockingRecv error: recv got EOF from 127.17.188.65:60041 (error 108)
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":102,"threads_started":1}
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:03.244203 28307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:03.234752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:56849)
0811 04:49:03.235059 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:03.235072 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:03.235179 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:03.235407 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:03.235409 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:03.235678 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:03.235790 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.235797 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.236631 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.236633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.237242 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.237250 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.237699 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.237701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.237762 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.242076 (+ 4314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:03.242094 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:03.244084 (+ 1990us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":130,"threads_started":1}
W20260811 04:49:03.244412 28306 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:03.234819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:56849 (local address 127.17.188.126:36253)
0811 04:49:03.234977 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:03.234982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:03.235148 (+ 166us) server_negotiation.cc:407] Connection header received
0811 04:49:03.235260 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:03.235262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:03.235310 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:03.235369 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:03.235901 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.236449 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.237359 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.237595 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.237681 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.244259 (+ 6578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:56849: BlockingRecv error: recv got EOF from 127.17.188.66:56849 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:03 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:03.429033 28308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:03.423181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:38855)
0811 04:49:03.423472 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:03.423487 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:03.423618 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:03.423857 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:03.423859 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:03.424049 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:03.424150 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.424155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.425018 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.425021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.425919 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:03.425931 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.426472 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.426474 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:03.426535 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.427071 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:03.427083 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:03.428917 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":121,"threads_started":1}
W20260811 04:49:03.429237 28306 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:03.423322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:38855 (local address 127.17.188.126:36253)
0811 04:49:03.423465 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:03.423469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:03.423588 (+ 119us) server_negotiation.cc:407] Connection header received
0811 04:49:03.423703 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:03.423706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:03.423755 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:03.423817 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:03.424299 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.424860 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.426051 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:03.426362 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:03.426450 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:03.429064 (+ 2614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:38855: BlockingRecv error: recv got EOF from 127.17.188.67:38855 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:04.055075 28309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:04.049113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:49007)
0811 04:49:04.049422 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:04.049483 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:04.049626 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:04.049897 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:04.049900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:04.050085 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:04.050179 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.050184 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.050997 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.050999 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.051546 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.051553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.052148 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.052152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.052249 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.053001 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:04.053017 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:04.054960 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":101,"threads_started":1}
W20260811 04:49:04.055374 28310 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:04.049203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:49007 (local address 127.17.188.126:36253)
0811 04:49:04.049563 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:04.049570 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:04.049635 (+ 65us) server_negotiation.cc:407] Connection header received
0811 04:49:04.049728 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:04.049731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:04.049780 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:04.049859 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:04.050287 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.050888 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.051661 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.052004 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.052131 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.055227 (+ 3096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:49007: BlockingRecv error: recv got EOF from 127.17.188.65:49007 (error 108)
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":100,"threads_started":1}
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:04.254297 28311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:04.245076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:39615)
0811 04:49:04.245354 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:04.245368 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:04.245460 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:04.245731 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:04.245733 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:04.245917 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:04.246008 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.246013 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.246750 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.246752 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.247309 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.247316 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.247796 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.247800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.247874 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.252188 (+ 4314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:04.252200 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:04.254178 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":103,"threads_started":1}
W20260811 04:49:04.254504 28310 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:04.245239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:39615 (local address 127.17.188.126:36253)
0811 04:49:04.245378 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:04.245382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:04.245419 (+ 37us) server_negotiation.cc:407] Connection header received
0811 04:49:04.245541 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:04.245544 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:04.245626 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:04.245697 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:04.246109 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.246658 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.247422 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.247670 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.247751 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.254364 (+ 6613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:39615: BlockingRecv error: recv got EOF from 127.17.188.66:39615 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:04 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:04.435601 28312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:04.429918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:44321)
0811 04:49:04.430251 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:04.430265 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:04.430365 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:04.430595 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:04.430597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:04.430790 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:04.430887 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.430892 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.431722 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.431725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.432388 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:04.432397 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.432848 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.432852 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:04.432935 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.433477 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:04.433488 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:04.435482 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":139,"threads_started":1}
W20260811 04:49:04.435758 28310 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:04.429994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:44321 (local address 127.17.188.126:36253)
0811 04:49:04.430171 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:04.430176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:04.430341 (+ 165us) server_negotiation.cc:407] Connection header received
0811 04:49:04.430444 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:04.430446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:04.430495 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:04.430554 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:04.430985 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.431622 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.432502 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:04.432725 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:04.432840 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:04.435630 (+ 2790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:44321: BlockingRecv error: recv got EOF from 127.17.188.67:44321 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:05.061017 28313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:05.055870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:59471)
0811 04:49:05.056161 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:05.056175 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:05.056274 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:05.056513 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:05.056515 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:05.056714 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:05.056808 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.056814 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.057538 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.057540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.058127 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.058134 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.058538 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.058540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.058601 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.059107 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:05.059118 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:05.060909 (+ 1791us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":92,"threads_started":1}
W20260811 04:49:05.061167 28314 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:05.055924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:59471 (local address 127.17.188.126:36253)
0811 04:49:05.056179 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:05.056183 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:05.056248 (+ 65us) server_negotiation.cc:407] Connection header received
0811 04:49:05.056355 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:05.056358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:05.056402 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:05.056478 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:05.056910 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.057439 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.058227 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.058446 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.058519 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.061036 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:59471: BlockingRecv error: recv got EOF from 127.17.188.65:59471 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":62,"threads_started":1}
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:05.260555 28315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:05.255150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:52551)
0811 04:49:05.255423 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:05.255442 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:05.255541 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:05.255849 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:05.255851 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:05.256038 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:05.256143 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.256148 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.256853 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.256855 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.257388 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.257395 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.257835 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.257839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.257911 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.258489 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:05.258522 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:05.260448 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":108,"threads_started":1}
W20260811 04:49:05.260825 28314 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:05.255248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:52551 (local address 127.17.188.126:36253)
0811 04:49:05.255392 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:05.255396 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:05.255509 (+ 113us) server_negotiation.cc:407] Connection header received
0811 04:49:05.255664 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:05.255667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:05.255714 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:05.255795 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:05.256246 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.256763 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.257484 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.257723 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.257797 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.260580 (+ 2783us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:52551: BlockingRecv error: recv got EOF from 127.17.188.66:52551 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:05 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:05.442222 28317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:05.436396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:46911)
0811 04:49:05.436707 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:05.436720 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:05.436850 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:05.437133 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:05.437136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:05.437374 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:05.437468 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.437473 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.438293 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.438298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.438891 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:05.438900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.439371 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.439375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:05.439464 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.440002 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:05.440014 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:05.442042 (+ 2028us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":89,"threads_started":1}
W20260811 04:49:05.442317 28314 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:05.436474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:46911 (local address 127.17.188.126:36253)
0811 04:49:05.436644 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:05.436650 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:05.436798 (+ 148us) server_negotiation.cc:407] Connection header received
0811 04:49:05.436962 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:05.436972 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:05.437021 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:05.437118 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:05.437625 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.438179 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.439018 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:05.439255 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:05.439367 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:05.442190 (+ 2823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:46911: BlockingRecv error: recv got EOF from 127.17.188.67:46911 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:06.068035 28319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:06.062081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:33395)
0811 04:49:06.062466 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:06.062479 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:06.062584 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:06.062833 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:06.062835 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:06.063029 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:06.063134 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.063140 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.063998 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.064001 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.064851 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.064864 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.065525 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.065532 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.065660 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.066148 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:06.066159 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:06.067924 (+ 1765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":117,"threads_started":1}
W20260811 04:49:06.068234 28318 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:06.062176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:33395 (local address 127.17.188.126:36253)
0811 04:49:06.062468 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:06.062472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:06.062571 (+ 99us) server_negotiation.cc:407] Connection header received
0811 04:49:06.062668 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:06.062670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:06.062717 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:06.062796 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:06.063230 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.063760 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.064993 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.065385 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.065500 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.068062 (+ 2562us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:33395: BlockingRecv error: recv got EOF from 127.17.188.65:33395 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":92,"threads_started":1}
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:06.266762 28320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:06.261361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:47813)
0811 04:49:06.261734 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:06.261748 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:06.261847 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:06.262092 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:06.262094 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:06.262285 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:06.262379 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.262384 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.263105 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.263108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.263652 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.263659 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.264095 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.264098 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.264218 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.264715 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:06.264726 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:06.266648 (+ 1922us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":138,"threads_started":1}
W20260811 04:49:06.266952 28318 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:06.261449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:47813 (local address 127.17.188.126:36253)
0811 04:49:06.261733 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:06.261737 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:06.261815 (+ 78us) server_negotiation.cc:407] Connection header received
0811 04:49:06.261924 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:06.261926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:06.261970 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:06.262046 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:06.262475 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.263010 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.263772 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.263991 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.264066 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.266793 (+ 2727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:47813: BlockingRecv error: recv got EOF from 127.17.188.66:47813 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:06 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:06.449126 28321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:06.443103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:54545)
0811 04:49:06.443466 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:06.443481 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:06.443588 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:06.443875 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:06.443877 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:06.444071 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:06.444243 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.444252 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.445143 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.445146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.445870 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:06.445880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.446320 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.446322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:06.446384 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.446992 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:06.447005 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:06.449003 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":128,"threads_started":1}
W20260811 04:49:06.449255 28318 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:06.443174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:54545 (local address 127.17.188.126:36253)
0811 04:49:06.443332 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:06.443336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:06.443579 (+ 243us) server_negotiation.cc:407] Connection header received
0811 04:49:06.443667 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:06.443670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:06.443778 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:06.443858 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:06.444381 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.445028 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.445976 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:06.446217 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:06.446298 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:06.449138 (+ 2840us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:54545: BlockingRecv error: recv got EOF from 127.17.188.67:54545 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:07.076560 28322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:07.068844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:41287)
0811 04:49:07.069116 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:07.069130 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:07.069247 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:07.069701 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:07.069707 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:07.069975 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:07.070139 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.070149 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.071391 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.071398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.072474 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.072486 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.073010 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.073016 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.073148 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.073854 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:07.073867 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:07.076383 (+ 2516us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":87,"threads_started":1}
W20260811 04:49:07.076643 28323 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:07.068979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:41287 (local address 127.17.188.126:36253)
0811 04:49:07.069379 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:07.069384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:07.069405 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:49:07.069469 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:07.069472 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:07.069526 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:07.069662 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:07.070277 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.071256 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.072596 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.072889 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.072966 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.076511 (+ 3545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:41287: BlockingRecv error: recv got EOF from 127.17.188.65:41287 (error 108)
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":206,"threads_started":1}
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:07.273195 28324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:07.267500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:34289)
0811 04:49:07.267915 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:07.267929 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:07.268071 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:07.268359 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:07.268362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:07.268576 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:07.268694 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.268701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.269634 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.269639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.270214 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.270222 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.270680 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.270684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.270766 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.271267 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:07.271279 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:07.273068 (+ 1789us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":102,"threads_started":1}
W20260811 04:49:07.273329 28323 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:07.267579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:34289 (local address 127.17.188.126:36253)
0811 04:49:07.267882 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:07.267887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:07.268019 (+ 132us) server_negotiation.cc:407] Connection header received
0811 04:49:07.268189 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:07.268193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:07.268245 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:07.268336 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:07.268824 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.269485 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.270340 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.270559 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.270678 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.273212 (+ 2534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:34289: BlockingRecv error: recv got EOF from 127.17.188.66:34289 (error 108)
Metrics: {"server-negotiator.queue_time_us":185}
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:07 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:07.455148 28325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:07.450040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:41445)
0811 04:49:07.450362 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:07.450376 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:07.450472 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:07.450705 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:07.450707 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:07.450887 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:07.450978 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.450983 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.451685 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.451687 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.452233 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:07.452240 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.452655 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.452658 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:07.452719 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.453189 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:07.453200 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:07.455031 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":96,"threads_started":1}
W20260811 04:49:07.455340 28323 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:07.450104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:41445 (local address 127.17.188.126:36253)
0811 04:49:07.450241 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:07.450245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:07.450446 (+ 201us) server_negotiation.cc:407] Connection header received
0811 04:49:07.450538 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:07.450540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:07.450585 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:07.450665 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:07.451074 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.451581 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.452333 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:07.452543 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:07.452628 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:07.455174 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:41445: BlockingRecv error: recv got EOF from 127.17.188.67:41445 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:08.083480 28326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:08.077787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:44833)
0811 04:49:08.078097 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:08.078120 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:08.078224 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:08.078452 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:08.078454 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:08.078642 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:08.078743 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.078749 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.079550 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.079553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.080126 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.080157 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.080673 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.080677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.080773 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.081361 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:08.081375 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:08.083311 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":116,"threads_started":1}
W20260811 04:49:08.083566 28327 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:08.077838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:44833 (local address 127.17.188.126:36253)
0811 04:49:08.078123 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:08.078127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:08.078176 (+ 49us) server_negotiation.cc:407] Connection header received
0811 04:49:08.078292 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:08.078294 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:08.078338 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:08.078419 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:08.078904 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.079453 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.080271 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.080519 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.080673 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.083438 (+ 2765us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:44833: BlockingRecv error: recv got EOF from 127.17.188.65:44833 (error 108)
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":86,"threads_started":1}
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:08.285363 28328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:08.274158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:36777)
0811 04:49:08.274440 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:08.274453 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:08.274580 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:08.274861 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:08.274863 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:08.275102 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:08.275225 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.275231 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.276098 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.276101 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.276788 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.276799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.277259 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.277261 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.277323 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.283176 (+ 5853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:08.283188 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:08.285221 (+ 2033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":107,"threads_started":1}
W20260811 04:49:08.285837 28327 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:08.274233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:36777 (local address 127.17.188.126:36253)
0811 04:49:08.274391 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:08.274396 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:08.274509 (+ 113us) server_negotiation.cc:407] Connection header received
0811 04:49:08.274703 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:08.274706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:08.274755 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:08.274825 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:08.275381 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.275997 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.276893 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.277143 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.277240 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.285395 (+ 8155us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:36777: BlockingRecv error: recv got EOF from 127.17.188.66:36777 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:08 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:08.462097 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:08.455871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:33043)
0811 04:49:08.456212 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:08.456227 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:08.456362 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:08.456641 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:08.456644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:08.456861 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:08.456953 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.456958 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.457777 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.457782 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.458379 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:08.458387 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.458918 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.458922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:08.459022 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.459615 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:08.459627 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:08.461925 (+ 2298us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":91,"threads_started":1}
W20260811 04:49:08.462154 28327 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:08.455997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:33043 (local address 127.17.188.126:36253)
0811 04:49:08.456156 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:08.456161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:08.456306 (+ 145us) server_negotiation.cc:407] Connection header received
0811 04:49:08.456470 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:08.456474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:08.456530 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:08.456615 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:08.457069 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.457667 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.458500 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:08.458728 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:08.458880 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:08.462045 (+ 3165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:33043: BlockingRecv error: recv got EOF from 127.17.188.67:33043 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:09.089934 28330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:09.084341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:51145)
0811 04:49:09.084626 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:09.084639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:09.084729 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:09.084941 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:09.084943 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:09.085122 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:09.085217 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.085222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.086031 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.086034 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.086601 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.086609 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.087033 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.087036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.087109 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.087610 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:09.087622 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:09.089823 (+ 2201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":118,"threads_started":1}
W20260811 04:49:09.090126 28331 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:09.084374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:51145 (local address 127.17.188.126:36253)
0811 04:49:09.084645 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:09.084649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:09.084691 (+ 42us) server_negotiation.cc:407] Connection header received
0811 04:49:09.084793 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:09.084795 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:09.084834 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:09.084909 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:09.085318 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.085932 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.086703 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.086934 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.087009 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.089966 (+ 2957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:51145: BlockingRecv error: recv got EOF from 127.17.188.65:51145 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":120,"threads_started":1}
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:09.291368 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:09.286160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:37455)
0811 04:49:09.286446 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:09.286459 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:09.286550 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:09.286789 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:09.286791 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:09.286971 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:09.287069 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.287075 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.287758 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.287761 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.288293 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.288300 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.288717 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.288721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.288791 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.289337 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:09.289349 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:09.291255 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":118,"threads_started":1}
W20260811 04:49:09.291545 28331 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:09.286249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:37455 (local address 127.17.188.126:36253)
0811 04:49:09.286391 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:09.286395 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:09.286527 (+ 132us) server_negotiation.cc:407] Connection header received
0811 04:49:09.286638 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:09.286641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:09.286681 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:09.286746 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:09.287169 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.287668 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.288392 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.288597 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.288668 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.291390 (+ 2722us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:37455: BlockingRecv error: recv got EOF from 127.17.188.66:37455 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:09 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:09.468842 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:09.462841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:36303)
0811 04:49:09.463162 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:09.463178 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:09.463292 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:09.463573 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:09.463576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:09.463817 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:09.463961 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.463968 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.464747 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.464749 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.465429 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:09.465438 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.466034 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.466037 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:09.466154 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.466789 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:09.466803 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:09.468708 (+ 1905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":101,"threads_started":1}
W20260811 04:49:09.468978 28331 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:09.463019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:36303 (local address 127.17.188.126:36253)
0811 04:49:09.463177 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:09.463182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:09.463239 (+ 57us) server_negotiation.cc:407] Connection header received
0811 04:49:09.463401 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:09.463404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:09.463462 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:09.463550 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:09.464111 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.464649 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.465592 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:09.465902 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:09.466019 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:09.468844 (+ 2825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:36303: BlockingRecv error: recv got EOF from 127.17.188.67:36303 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:10.095857 28334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:10.090785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:43925)
0811 04:49:10.091084 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:10.091098 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:10.091189 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:10.091433 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:10.091435 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:10.091621 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:10.091713 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.091718 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.092449 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.092451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.092982 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.092989 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.093396 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.093399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.093458 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.093957 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:10.093968 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:10.095717 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":72,"threads_started":1}
W20260811 04:49:10.096030 28335 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:10.090866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:43925 (local address 127.17.188.126:36253)
0811 04:49:10.091156 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:10.091159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:10.091172 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:49:10.091275 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:10.091278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:10.091321 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:10.091395 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:10.091815 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.092361 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.093089 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.093301 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.093374 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.095866 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:43925: BlockingRecv error: recv got EOF from 127.17.188.65:43925 (error 108)
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":93,"threads_started":1}
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:10.297958 28336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:10.292160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:33947)
0811 04:49:10.292442 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:10.292456 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:10.292553 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:10.292793 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:10.292795 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:10.292978 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:10.293074 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.293079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.293975 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.293981 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.294853 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.294882 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.295386 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.295389 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.295455 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.295949 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:10.295973 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:10.297843 (+ 1870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":77,"threads_started":1}
W20260811 04:49:10.298111 28335 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:10.292293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:33947 (local address 127.17.188.126:36253)
0811 04:49:10.292470 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:10.292474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:10.292504 (+ 30us) server_negotiation.cc:407] Connection header received
0811 04:49:10.292639 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:10.292641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:10.292686 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:10.292753 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:10.293181 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.293851 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.294985 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.295275 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.295363 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.297994 (+ 2631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:33947: BlockingRecv error: recv got EOF from 127.17.188.66:33947 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:10 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:10.475402 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:10.469819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:38067)
0811 04:49:10.470164 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:10.470177 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:10.470325 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:10.470627 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:10.470629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:10.470843 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:10.470934 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.470939 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.471695 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.471700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.472258 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:10.472266 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.472728 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.472731 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:10.472814 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.473320 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:10.473331 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:10.475285 (+ 1954us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":87,"threads_started":1}
W20260811 04:49:10.475682 28335 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:10.469934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:38067 (local address 127.17.188.126:36253)
0811 04:49:10.470102 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:10.470108 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:10.470265 (+ 157us) server_negotiation.cc:407] Connection header received
0811 04:49:10.470423 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:10.470427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:10.470481 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:10.470604 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:10.471053 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.471585 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.472379 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:10.472612 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:10.472722 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:10.475432 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:38067: BlockingRecv error: recv got EOF from 127.17.188.67:38067 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:11.102097 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:11.096774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:43277)
0811 04:49:11.097084 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:11.097097 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:11.097187 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:11.097435 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:11.097437 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:11.097645 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:11.097744 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.097750 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.098515 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.098518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.099082 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.099089 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.099505 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.099507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.099572 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.100074 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:11.100085 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:11.101970 (+ 1885us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":83,"threads_started":1}
W20260811 04:49:11.102239 28339 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:11.096899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:43277 (local address 127.17.188.126:36253)
0811 04:49:11.097135 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:11.097138 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:11.097152 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:49:11.097273 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:11.097275 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:11.097318 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:11.097395 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:11.097846 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.098424 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.099191 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.099410 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.099483 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.102102 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:43277: BlockingRecv error: recv got EOF from 127.17.188.65:43277 (error 108)
Metrics: {"server-negotiator.queue_time_us":163,"thread_start_us":59,"threads_started":1}
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:11.304610 28340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:11.299014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:54243)
0811 04:49:11.299350 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:11.299364 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:11.299497 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:11.299843 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:11.299847 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:11.300082 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:11.300182 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.300188 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.300913 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.300915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.301466 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.301474 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.301954 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.301957 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.302024 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.302512 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:11.302524 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:11.304473 (+ 1949us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":123,"threads_started":1}
W20260811 04:49:11.304847 28339 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:11.299099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:54243 (local address 127.17.188.126:36253)
0811 04:49:11.299266 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:11.299274 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:11.299444 (+ 170us) server_negotiation.cc:407] Connection header received
0811 04:49:11.299646 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:11.299649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:11.299708 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:11.299799 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:11.300289 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.300811 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.301568 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.301851 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.301931 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.304620 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:54243: BlockingRecv error: recv got EOF from 127.17.188.66:54243 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:11 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:11.482054 28341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:11.476376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:42965)
0811 04:49:11.476678 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:11.476694 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:11.476847 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:11.477124 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:11.477127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:11.477384 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:11.477486 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.477493 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.478295 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.478300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.478866 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:11.478874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.479353 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.479356 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:11.479444 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.479933 (+ 489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:11.479944 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:11.481884 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":87,"threads_started":1}
W20260811 04:49:11.482201 28339 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:11.476441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:42965 (local address 127.17.188.126:36253)
0811 04:49:11.476651 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:11.476656 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:11.476783 (+ 127us) server_negotiation.cc:407] Connection header received
0811 04:49:11.476950 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:11.476953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:11.477010 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:11.477098 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:11.477639 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.478181 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.478992 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:11.479240 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:11.479348 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:11.482062 (+ 2714us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:42965: BlockingRecv error: recv got EOF from 127.17.188.67:42965 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:12.108438 28342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:12.103122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:51429)
0811 04:49:12.103386 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:12.103400 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:12.103527 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:12.103862 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:12.103865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:12.104077 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:12.104225 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.104235 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.105001 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.105003 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.105558 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.105565 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.106012 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.106014 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.106076 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.106591 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:12.106603 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:12.108331 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":93,"threads_started":1}
W20260811 04:49:12.108592 28343 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:12.103220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:51429 (local address 127.17.188.126:36253)
0811 04:49:12.103495 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:12.103498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:12.103510 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:49:12.103640 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:12.103643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:12.103705 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:12.103805 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:12.104375 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.104912 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.105710 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.105922 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.105992 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.108466 (+ 2474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:51429: BlockingRecv error: recv got EOF from 127.17.188.65:51429 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:12.311304 28344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:12.305560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:35863)
0811 04:49:12.305948 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:12.305965 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:12.306084 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:12.306394 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:12.306397 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:12.306613 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:12.306711 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.306717 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.307467 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.307472 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.308043 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.308051 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.308525 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.308529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.308614 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.309113 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:12.309124 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:12.311135 (+ 2011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":134,"threads_started":1}
W20260811 04:49:12.311435 28343 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:12.305790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:35863 (local address 127.17.188.126:36253)
0811 04:49:12.305949 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:12.305955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:12.306025 (+ 70us) server_negotiation.cc:407] Connection header received
0811 04:49:12.306220 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:12.306223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:12.306279 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:12.306368 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:12.306833 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.307358 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.308172 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.308405 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.308509 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.311300 (+ 2791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:35863: BlockingRecv error: recv got EOF from 127.17.188.66:35863 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:12 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:12.488834 28345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:12.483095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:53841)
0811 04:49:12.483380 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:12.483394 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:12.483496 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:12.483766 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:12.483768 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:12.483957 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:12.484055 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.484061 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.485025 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.485028 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.485878 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:12.485890 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.486308 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.486310 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:12.486368 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.486847 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:12.486858 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:12.488723 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":92,"threads_started":1}
W20260811 04:49:12.488971 28343 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:12.483195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:53841 (local address 127.17.188.126:36253)
0811 04:49:12.483353 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:12.483357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:12.483464 (+ 107us) server_negotiation.cc:407] Connection header received
0811 04:49:12.483602 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:12.483604 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:12.483656 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:12.483722 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:12.484173 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.484891 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.485990 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:12.486211 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:12.486291 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:12.488858 (+ 2567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:53841: BlockingRecv error: recv got EOF from 127.17.188.67:53841 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:13.114694 28346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:13.109331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:36705)
0811 04:49:13.109689 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:13.109703 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:13.109798 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:13.110016 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:13.110018 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:13.110200 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:13.110291 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.110296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.110996 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.110998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.111527 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.111534 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.111926 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.111928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.111989 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.112551 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:13.112562 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:13.114500 (+ 1938us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":136,"threads_started":1}
W20260811 04:49:13.114795 28348 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:13.109396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:36705 (local address 127.17.188.126:36253)
0811 04:49:13.109714 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:13.109718 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:13.109753 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:49:13.109883 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:13.109885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:13.109928 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:13.110005 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:13.110386 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.110904 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.111623 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.111833 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.111904 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.114659 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:36705: BlockingRecv error: recv got EOF from 127.17.188.65:36705 (error 108)
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":90,"threads_started":1}
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:13.321797 28349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:13.312093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:56877)
0811 04:49:13.312400 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:13.312413 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:13.312509 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:13.312736 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:13.312738 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:13.312922 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:13.313014 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.313019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.313805 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.313807 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.314348 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.314355 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.314847 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.314850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.314912 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.319570 (+ 4658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:13.319583 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:13.321627 (+ 2044us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":123,"threads_started":1}
W20260811 04:49:13.321872 28348 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:13.312158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:56877 (local address 127.17.188.126:36253)
0811 04:49:13.312312 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:13.312317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:13.312483 (+ 166us) server_negotiation.cc:407] Connection header received
0811 04:49:13.312591 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:13.312593 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:13.312638 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:13.312703 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:13.313122 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.313713 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.314477 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.314743 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.314830 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.321757 (+ 6927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:56877: BlockingRecv error: recv got EOF from 127.17.188.66:56877 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:13 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.67@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:13.495265 28350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:13.489717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.67:38243)
0811 04:49:13.489985 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:13.489998 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:13.490096 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:13.490378 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:13.490381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:13.490584 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:13.490682 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.490687 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.491399 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.491401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.492121 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:13.492131 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.492615 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.492618 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:13.492710 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.493216 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:13.493227 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:13.495153 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":90,"threads_started":1}
W20260811 04:49:13.495433 28348 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:13.489784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:38243 (local address 127.17.188.126:36253)
0811 04:49:13.489950 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:13.489954 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:13.490067 (+ 113us) server_negotiation.cc:407] Connection header received
0811 04:49:13.490179 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:13.490181 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:13.490228 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:13.490299 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:13.490786 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.491305 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.492267 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:13.492487 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:13.492600 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:13.495278 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.67:38243: BlockingRecv error: recv got EOF from 127.17.188.67:38243 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 04:49:14 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:14 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.65@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:14.121039 28351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:14.115536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.65:59267)
0811 04:49:14.115808 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:14.115823 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:14.115910 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:14.116123 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:14.116125 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:14.116320 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:14.116413 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.116418 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.117166 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.117168 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.117796 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.117805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.118215 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.118218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.118277 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.118844 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:14.118857 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:14.120887 (+ 2030us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
W20260811 04:49:14.121207 28352 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:14.115632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:59267 (local address 127.17.188.126:36253)
0811 04:49:14.115908 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:14.115911 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:14.115924 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:49:14.115980 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:14.115982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:14.116023 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:14.116095 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:14.116518 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.117065 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.117899 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.118123 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.118197 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.121049 (+ 2852us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.65:59267: BlockingRecv error: recv got EOF from 127.17.188.65:59267 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":78,"threads_started":1}
Aug 11 04:49:14 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
Aug 11 04:49:14 dist-test-slave-njxd krb5kdc[27189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.17.188.66@KRBTEST.COM for oryx/127.17.188.126@KRBTEST.COM, Server not found in Kerberos database
I20260811 04:49:14.328444 28353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:14.322682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36253 (local address 127.17.188.66:49161)
0811 04:49:14.323019 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:14.323032 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:14.323165 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:14.323431 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:14.323434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:14.323689 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:14.323778 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.323784 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.324524 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.324529 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.325104 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.325112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.325567 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.325600 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.325700 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.326228 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:14.326240 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:14.328310 (+ 2070us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.17.188.126:36253: Server oryx/127.17.188.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":104,"threads_started":1}
W20260811 04:49:14.328559 28352 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:14.322807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:49161 (local address 127.17.188.126:36253)
0811 04:49:14.322970 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:14.322974 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:14.323105 (+ 131us) server_negotiation.cc:407] Connection header received
0811 04:49:14.323266 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:14.323269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:14.323321 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:14.323408 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:14.323898 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.324416 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.325231 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.325452 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.325554 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.328447 (+ 2893us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.17.188.66:49161: BlockingRecv error: recv got EOF from 127.17.188.66:49161 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:49:14.383985 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27824
I20260811 04:49:14.392544 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27994
I20260811 04:49:14.399094 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28140
I20260811 04:49:14.405268 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 27749
2026-08-11T04:49:14Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18061 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T04:49:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:49:14Z Disabled control of system clock
I20260811 04:49:14.440135 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38065
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:34831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38065
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 04:49:14.551705 28357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:14.552062 28357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:14.552201 28357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:14.559479 28357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:49:14.559576 28357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:14.559665 28357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:14.559713 28357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:49:14.559754 28357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:49:14.568236 28357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38065
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:14.569334 28357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:14.571101 28357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:14.581511 28365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:14.581525 28363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:14.581525 28362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:14.587014 28357 server_base.cc:1034] running on GCE node
I20260811 04:49:14.587591 28357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:14.588971 28357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:14.590157 28357 hybrid_clock.cc:648] HybridClock initialized: now 1786423754590130 us; error 42 us; skew 500 ppm
I20260811 04:49:14.592422 28357 webserver.cc:460] Webserver started at http://127.17.188.126:33261/ using document root <none> and password file <none>
I20260811 04:49:14.593134 28357 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:14.593215 28357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:14.593427 28357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:14.595631 28357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "1ad9a0d7317732a8bf801893db63c374"
server_key_iv: "8046e46a0fb2335d381a6407b61dae5a"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.596249 28357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "1ad9a0d7317732a8bf801893db63c374"
server_key_iv: "8046e46a0fb2335d381a6407b61dae5a"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.599673 28357 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:49:14.601912 28371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:14.603077 28357 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:49:14.603212 28357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "1ad9a0d7317732a8bf801893db63c374"
server_key_iv: "8046e46a0fb2335d381a6407b61dae5a"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.603317 28357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:14.622113 28357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:14.622834 28357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:14.623047 28357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:14.630079 28357 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:38065
I20260811 04:49:14.630107 28428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:38065 every 8 connection(s)
I20260811 04:49:14.631053 28357 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:49:14.634195 28429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:14.636183 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28357
I20260811 04:49:14.636324 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:49:14.636610 18161 external_mini_cluster.cc:1428] Setting key 30f38afd1b5d188295aa32b9f149e95e
I20260811 04:49:14.640780 28429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2: Bootstrap starting.
I20260811 04:49:14.642995 28429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:14.643874 28429 log.cc:824] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:14.645661 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:14.637998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42054 (local address 127.17.188.126:38065)
0811 04:49:14.638583 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:14.638597 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:14.638633 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:49:14.639308 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:14.639326 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:14.639715 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:14.640046 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:14.640480 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.641491 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.642382 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.642848 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.643015 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.643884 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:14.643890 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:14.643901 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:14.644328 (+ 427us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:14.644385 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:14.644405 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:14.644512 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:14.644673 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 04:49:14.644930 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":118,"threads_started":1}
I20260811 04:49:14.645995 28429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2: No bootstrap required, opened a new log
I20260811 04:49:14.649971 28429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } }
I20260811 04:49:14.650195 28429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:14.650229 28429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c86b7cde2d41e8b1ba7ca9ed4446e2, State: Initialized, Role: FOLLOWER
I20260811 04:49:14.650622 28429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } }
I20260811 04:49:14.650750 28429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:49:14.650790 28429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:49:14.650864 28429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:14.651708 28429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } }
I20260811 04:49:14.652011 28429 leader_election.cc:302] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31c86b7cde2d41e8b1ba7ca9ed4446e2; no voters:
I20260811 04:49:14.652290 28429 leader_election.cc:288] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:49:14.652467 28436 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:49:14.652715 28436 raft_consensus.cc:686] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [term 1 LEADER]: Becoming Leader. State: Replica: 31c86b7cde2d41e8b1ba7ca9ed4446e2, State: Running, Role: LEADER
I20260811 04:49:14.653015 28436 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } }
I20260811 04:49:14.653510 28429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:49:14.654663 28439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31c86b7cde2d41e8b1ba7ca9ed4446e2. Latest consensus state: current_term: 1 leader_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } } }
I20260811 04:49:14.654789 28439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:14.654994 28438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31c86b7cde2d41e8b1ba7ca9ed4446e2" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38065 } } }
I20260811 04:49:14.655162 28438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2 [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:14.655174 28446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:49:14.658381 28446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:49:14.663890 28446 catalog_manager.cc:1347] Generated new cluster ID: baf0e8446ef44c0daf505a0931931c2e
I20260811 04:49:14.663971 28446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:49:14.683977 28446 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:49:14.684873 28446 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:49:14.690302 28446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 31c86b7cde2d41e8b1ba7ca9ed4446e2: Generated new TSK 0
I20260811 04:49:14.691028 28446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:49:14.698907 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--builtin_ntp_servers=127.17.188.84:34831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 04:49:14.807224 28456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:14.807478 28456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:14.807544 28456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:14.811486 28456 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:14.811559 28456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:14.811650 28456 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:49:14.816229 28456 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28456
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:14.817211 28456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:14.818565 28456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:14.828172 28467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:14.828137 28463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:14.828291 28456 server_base.cc:1034] running on GCE node
W20260811 04:49:14.828137 28464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:14.828825 28456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:14.829406 28456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:14.830564 28456 hybrid_clock.cc:648] HybridClock initialized: now 1786423754830553 us; error 34 us; skew 500 ppm
I20260811 04:49:14.832361 28456 webserver.cc:460] Webserver started at http://127.17.188.65:36899/ using document root <none> and password file <none>
I20260811 04:49:14.832921 28456 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:14.832981 28456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:14.833230 28456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:14.835290 28456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "58cec271f9394d5ab301bfcc07d8802e"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "59fd91f923636a454aba6a4cf375fed9"
server_key_iv: "d86c401e3bb58bf88619a3640b7a1432"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.835855 28456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "58cec271f9394d5ab301bfcc07d8802e"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "59fd91f923636a454aba6a4cf375fed9"
server_key_iv: "d86c401e3bb58bf88619a3640b7a1432"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.839510 28456 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:49:14.842089 28473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:14.843355 28456 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:14.843479 28456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "58cec271f9394d5ab301bfcc07d8802e"
format_stamp: "Formatted at 2026-08-11 04:49:14 on dist-test-slave-njxd"
server_key: "59fd91f923636a454aba6a4cf375fed9"
server_key_iv: "d86c401e3bb58bf88619a3640b7a1432"
server_key_version: "encryptionkey@0"
I20260811 04:49:14.843588 28456 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:14.857132 28456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:14.857873 28456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:14.858074 28456 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:14.858698 28456 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:14.859688 28456 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:14.859762 28456 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:14.859848 28456 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:14.859879 28456 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:14.868319 28456 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:34753
I20260811 04:49:14.868381 28601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:34753 every 8 connection(s)
I20260811 04:49:14.869284 28456 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:49:14.875795 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28456
I20260811 04:49:14.875919 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:49:14.876217 18161 external_mini_cluster.cc:1428] Setting key 73d7bbd30949406f60904066d95fd4f3
I20260811 04:49:14.878422 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--builtin_ntp_servers=127.17.188.84:34831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 04:49:14.879227 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:14.871101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:52371 (local address 127.17.188.126:38065)
0811 04:49:14.871272 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:14.871276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:14.872330 (+ 1054us) server_negotiation.cc:407] Connection header received
0811 04:49:14.873719 (+ 1389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:14.873722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:14.873774 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:14.873852 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:14.874900 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.875436 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.877006 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.877369 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.877477 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.878672 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:14.878696 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:14.878702 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:14.878719 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:14.878747 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:14.878760 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:14.878809 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:14.879047 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 04:49:14.879111 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":71}
I20260811 04:49:14.880363 28604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:14.871496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38065 (local address 127.17.188.65:52371)
0811 04:49:14.872147 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:14.872213 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:14.873462 (+ 1249us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:14.874013 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:14.874020 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:14.874101 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:14.874751 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.874771 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.875581 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.875585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.876885 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:14.876896 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:14.877538 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:14.877544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:14.877755 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:14.878359 (+ 604us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:14.878361 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:14.878411 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:14.878495 (+ 84us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:14.878878 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:14.878890 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:14.878898 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:49:14.879022 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 04:49:14.879329 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":115,"threads_started":1}
I20260811 04:49:14.881773 28602 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38065
I20260811 04:49:14.881996 28602 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:14.882500 28602 heartbeater.cc:511] Master 127.17.188.126:38065 requested a full tablet report, sending...
I20260811 04:49:14.884184 28391 ts_manager.cc:194] Registered new tserver with Master: 58cec271f9394d5ab301bfcc07d8802e (127.17.188.65:34753)
I20260811 04:49:14.885897 28391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.65:52371
W20260811 04:49:14.991684 28605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:14.991914 28605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:14.991947 28605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:14.995785 28605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:14.995827 28605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:14.995875 28605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:49:15.000406 28605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:15.001329 28605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:15.002610 28605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:15.011749 28612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.011811 28605 server_base.cc:1034] running on GCE node
W20260811 04:49:15.011740 28611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.011740 28614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.012444 28605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:15.013011 28605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:15.014192 28605 hybrid_clock.cc:648] HybridClock initialized: now 1786423755014182 us; error 30 us; skew 500 ppm
I20260811 04:49:15.015978 28605 webserver.cc:460] Webserver started at http://127.17.188.66:44125/ using document root <none> and password file <none>
I20260811 04:49:15.016531 28605 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:15.016611 28605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:15.016829 28605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:15.018795 28605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "1bbf4e73efb74d9a82674e1531175601"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "e35f7b2792bdb537d26f11f6b8549c2e"
server_key_iv: "bf195602fd2bd68ea67fc40af67baa4f"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.019328 28605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "1bbf4e73efb74d9a82674e1531175601"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "e35f7b2792bdb537d26f11f6b8549c2e"
server_key_iv: "bf195602fd2bd68ea67fc40af67baa4f"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.022894 28605 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:49:15.025658 28620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.026865 28605 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:15.027091 28605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "1bbf4e73efb74d9a82674e1531175601"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "e35f7b2792bdb537d26f11f6b8549c2e"
server_key_iv: "bf195602fd2bd68ea67fc40af67baa4f"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.027199 28605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:15.050513 28605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:15.051229 28605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:15.051419 28605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:15.052023 28605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:15.052956 28605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:15.053025 28605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.053109 28605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:15.053151 28605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.061828 28605 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:42725
I20260811 04:49:15.061928 28743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:42725 every 8 connection(s)
I20260811 04:49:15.062698 28605 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:49:15.065876 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28605
I20260811 04:49:15.065992 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:49:15.066298 18161 external_mini_cluster.cc:1428] Setting key c975510db8979f1df8453bdc927eb604
I20260811 04:49:15.068396 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--builtin_ntp_servers=127.17.188.84:34831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 04:49:15.073468 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.064505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:45359 (local address 127.17.188.126:38065)
0811 04:49:15.064677 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.064682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.065770 (+ 1088us) server_negotiation.cc:407] Connection header received
0811 04:49:15.067472 (+ 1702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.067477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.067525 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.067634 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.068805 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.069437 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.070930 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.071356 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.071491 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:15.072796 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:15.072803 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:15.072809 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:15.072827 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:15.072854 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:15.072866 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:15.072952 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:15.073182 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 04:49:15.073263 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:49:15.074452 28746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.064924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38065 (local address 127.17.188.66:45359)
0811 04:49:15.065554 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:15.065658 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:15.067276 (+ 1618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:15.067833 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:15.067842 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:15.067942 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:15.068614 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:15.068636 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.069612 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.069619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:15.070805 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:15.070815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.071543 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.071547 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:15.071781 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:15.072530 (+ 749us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:15.072531 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:15.072570 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:15.072631 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:15.072979 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:15.072991 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:15.073000 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 04:49:15.073145 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 04:49:15.073495 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":115,"threads_started":1}
I20260811 04:49:15.075639 28744 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38065
I20260811 04:49:15.075884 28744 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:15.076475 28744 heartbeater.cc:511] Master 127.17.188.126:38065 requested a full tablet report, sending...
I20260811 04:49:15.077816 28391 ts_manager.cc:194] Registered new tserver with Master: 1bbf4e73efb74d9a82674e1531175601 (127.17.188.66:42725)
I20260811 04:49:15.078444 28391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.66:45359
W20260811 04:49:15.186376 28747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:15.186591 28747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:15.186631 28747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:15.190363 28747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:15.190433 28747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:15.190514 28747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:49:15.195086 28747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:38065
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:15.196010 28747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:15.197237 28747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:15.206322 28752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.206322 28753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.206453 28747 server_base.cc:1034] running on GCE node
W20260811 04:49:15.206336 28755 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.206938 28747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:15.207626 28747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:15.208781 28747 hybrid_clock.cc:648] HybridClock initialized: now 1786423755208782 us; error 44 us; skew 500 ppm
I20260811 04:49:15.210435 28747 webserver.cc:460] Webserver started at http://127.17.188.67:44773/ using document root <none> and password file <none>
I20260811 04:49:15.210934 28747 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:15.210988 28747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:15.211139 28747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:15.212987 28747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "e913894c89d64a17808e0dfcd2459b20"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3245947d077518699a6bcb1466b30854"
server_key_iv: "a89ca48a5649d7a97bd5bbb448385940"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.213502 28747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "e913894c89d64a17808e0dfcd2459b20"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3245947d077518699a6bcb1466b30854"
server_key_iv: "a89ca48a5649d7a97bd5bbb448385940"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.217054 28747 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:49:15.219463 28762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.220623 28747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:49:15.220713 28747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "e913894c89d64a17808e0dfcd2459b20"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3245947d077518699a6bcb1466b30854"
server_key_iv: "a89ca48a5649d7a97bd5bbb448385940"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.220793 28747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:15.237329 28747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:15.237898 28747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:15.238035 28747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:15.238518 28747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:15.239372 28747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:15.239414 28747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.239450 28747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:15.239465 28747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.248159 28747 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:42705
I20260811 04:49:15.248193 28891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:42705 every 8 connection(s)
I20260811 04:49:15.248991 28747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:49:15.249797 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28747
I20260811 04:49:15.249900 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:49:15.250211 18161 external_mini_cluster.cc:1428] Setting key 186fbe572d5f3243b041e13e4c99227e
I20260811 04:49:15.258486 28434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.250959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:39767 (local address 127.17.188.126:38065)
0811 04:49:15.251099 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.251106 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.252380 (+ 1274us) server_negotiation.cc:407] Connection header received
0811 04:49:15.253902 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.253904 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.253949 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.254013 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.254897 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.255487 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.256561 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.256774 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.256847 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:15.258081 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:15.258084 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:15.258086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:15.258097 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:15.258113 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:15.258120 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:15.258178 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:15.258318 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 04:49:15.258366 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:49:15.259338 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.251397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38065 (local address 127.17.188.67:39767)
0811 04:49:15.252223 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:15.252279 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:15.253634 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:15.254180 (+ 546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:15.254186 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:15.254265 (+ 79us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:15.254746 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:15.254758 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.255584 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.255587 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:15.256459 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:15.256469 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:15.256918 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:15.256921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:15.257080 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:15.257853 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:15.257855 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:15.257894 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:15.257954 (+ 60us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:15.258195 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:15.258202 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:15.258206 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:49:15.258299 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 04:49:15.258522 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":150,"threads_started":1}
I20260811 04:49:15.260535 28893 heartbeater.cc:347] Connected to a master server at 127.17.188.126:38065
I20260811 04:49:15.260818 28893 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:15.261343 28893 heartbeater.cc:511] Master 127.17.188.126:38065 requested a full tablet report, sending...
I20260811 04:49:15.262442 28391 ts_manager.cc:194] Registered new tserver with Master: e913894c89d64a17808e0dfcd2459b20 (127.17.188.67:42705)
I20260811 04:49:15.263145 28391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.67:39767
I20260811 04:49:15.264246 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 04:49:15.267264 28434 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:15.266297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42066 (local address 127.17.188.126:38065)
0811 04:49:15.266472 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.266476 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.266624 (+ 148us) server_negotiation.cc:407] Connection header received
0811 04:49:15.266720 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.266722 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.266757 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.266821 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.267132 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42066: BlockingRecv error: recv got EOF from 127.0.0.1:42066 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 04:49:15.267393 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28456
I20260811 04:49:15.283517 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28605
I20260811 04:49:15.294299 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28747
I20260811 04:49:15.301244 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28357
2026-08-11T04:49:15Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (892 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T04:49:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:49:15Z Disabled control of system clock
I20260811 04:49:15.332973 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34517
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 04:49:15.447086 28904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:15.447367 28904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:15.447407 28904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:15.451751 28904 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:49:15.451812 28904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:15.451828 28904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:15.451845 28904 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:49:15.451890 28904 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:49:15.456826 28904 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34517
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:15.458045 28904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:15.459463 28904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:15.468573 28911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.468567 28913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.468567 28910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.468627 28904 server_base.cc:1034] running on GCE node
I20260811 04:49:15.469376 28904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:15.470538 28904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:15.471740 28904 hybrid_clock.cc:648] HybridClock initialized: now 1786423755471726 us; error 27 us; skew 500 ppm
I20260811 04:49:15.473613 28904 webserver.cc:460] Webserver started at http://127.17.188.126:33293/ using document root <none> and password file <none>
I20260811 04:49:15.474200 28904 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:15.474295 28904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:15.474516 28904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:15.476650 28904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "53034d52a21047e0b09b40b25875b332"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "dc9fd4d01fcd5bc9501e4a168e8125d4"
server_key_iv: "2d51bd36fd29bafee6de498ad836e623"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.477252 28904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "53034d52a21047e0b09b40b25875b332"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "dc9fd4d01fcd5bc9501e4a168e8125d4"
server_key_iv: "2d51bd36fd29bafee6de498ad836e623"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.480989 28904 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:49:15.483501 28919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.484818 28904 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:49:15.484972 28904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "53034d52a21047e0b09b40b25875b332"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "dc9fd4d01fcd5bc9501e4a168e8125d4"
server_key_iv: "2d51bd36fd29bafee6de498ad836e623"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.485095 28904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:15.489771 28904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:15.490370 28904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:15.490581 28904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:15.497216 28904 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34517
I20260811 04:49:15.497221 28978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34517 every 8 connection(s)
I20260811 04:49:15.498200 28904 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:49:15.498549 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 28904
I20260811 04:49:15.498696 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:49:15.499069 18161 external_mini_cluster.cc:1428] Setting key f6b5fefa35e771e37a34603ca4ab0ffe
I20260811 04:49:15.501727 28979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:15.505298 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.500537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.17.188.126:34517)
0811 04:49:15.501754 (+ 1217us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.501769 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.501808 (+ 39us) server_negotiation.cc:407] Connection header received
0811 04:49:15.502502 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.502519 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.502869 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.503222 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.504074 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:15.504079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:15.504091 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:15.504102 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:15.504157 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:15.504173 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:15.504326 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:15.504397 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 04:49:15.504635 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":628,"threads_started":1}
I20260811 04:49:15.507762 28979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332: Bootstrap starting.
I20260811 04:49:15.509925 28979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:15.510708 28979 log.cc:824] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:15.512787 28979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332: No bootstrap required, opened a new log
I20260811 04:49:15.516453 28979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } }
I20260811 04:49:15.516695 28979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:15.516778 28979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53034d52a21047e0b09b40b25875b332, State: Initialized, Role: FOLLOWER
I20260811 04:49:15.517238 28979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } }
I20260811 04:49:15.517392 28979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:49:15.517481 28979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:49:15.517603 28979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:15.518491 28979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } }
I20260811 04:49:15.518827 28979 leader_election.cc:302] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53034d52a21047e0b09b40b25875b332; no voters:
I20260811 04:49:15.519165 28979 leader_election.cc:288] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:49:15.519289 28986 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:49:15.519532 28986 raft_consensus.cc:686] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [term 1 LEADER]: Becoming Leader. State: Replica: 53034d52a21047e0b09b40b25875b332, State: Running, Role: LEADER
I20260811 04:49:15.519873 28986 consensus_queue.cc:237] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } }
I20260811 04:49:15.520359 28979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:49:15.521625 28989 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 53034d52a21047e0b09b40b25875b332. Latest consensus state: current_term: 1 leader_uuid: "53034d52a21047e0b09b40b25875b332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } } }
I20260811 04:49:15.521662 28988 sys_catalog.cc:455] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "53034d52a21047e0b09b40b25875b332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53034d52a21047e0b09b40b25875b332" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34517 } } }
I20260811 04:49:15.521787 28989 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:15.521790 28988 sys_catalog.cc:458] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332 [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:15.522198 28996 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:49:15.525988 28996 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:49:15.531250 28996 catalog_manager.cc:1347] Generated new cluster ID: a71055a71bc54cfd851f9dc31e4bb5ba
I20260811 04:49:15.531313 28996 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:49:15.540578 28996 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:49:15.540887 28996 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:49:15.548718 28996 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 53034d52a21047e0b09b40b25875b332: Generated new TSK 0
I20260811 04:49:15.549376 28996 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:49:15.555378 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--builtin_ntp_servers=127.17.188.84:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 04:49:15.679852 29008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:15.680099 29008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:15.680171 29008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:15.684255 29008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:15.684304 29008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:15.684392 29008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:49:15.689153 29008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:15.690212 29008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:15.691581 29008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:15.701537 29015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.701545 29014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.701709 29008 server_base.cc:1034] running on GCE node
W20260811 04:49:15.701597 29017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.702298 29008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:15.702888 29008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:15.704061 29008 hybrid_clock.cc:648] HybridClock initialized: now 1786423755704042 us; error 29 us; skew 500 ppm
I20260811 04:49:15.706069 29008 webserver.cc:460] Webserver started at http://127.17.188.65:37653/ using document root <none> and password file <none>
I20260811 04:49:15.706669 29008 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:15.706735 29008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:15.706990 29008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:15.709631 29008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "14f81fde263645a9bc3f55178fb54eab"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3ac3d34a2ff7c8568578c5563d51045e"
server_key_iv: "74c33d3c12e9cf7a1a55ce0ce215c28b"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.710259 29008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "14f81fde263645a9bc3f55178fb54eab"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3ac3d34a2ff7c8568578c5563d51045e"
server_key_iv: "74c33d3c12e9cf7a1a55ce0ce215c28b"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.714148 29008 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:49:15.716836 29023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.718294 29008 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:49:15.718429 29008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "14f81fde263645a9bc3f55178fb54eab"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "3ac3d34a2ff7c8568578c5563d51045e"
server_key_iv: "74c33d3c12e9cf7a1a55ce0ce215c28b"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.718542 29008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:15.723222 29008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:15.723819 29008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:15.724023 29008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:15.724538 29008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:15.725426 29008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:15.725498 29008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.725564 29008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:15.725643 29008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.734356 29008 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:40781
I20260811 04:49:15.734382 29148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:40781 every 8 connection(s)
I20260811 04:49:15.735240 29008 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:49:15.741217 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.736990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:50151 (local address 127.17.188.126:34517)
0811 04:49:15.737136 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.737140 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.738172 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 04:49:15.739486 (+ 1314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.739490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.739536 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.739650 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.740710 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:15.740714 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:15.740716 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:15.740729 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:15.740759 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:15.740768 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:15.740877 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:15.741028 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 04:49:15.741074 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 04:49:15.742120 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.737352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34517 (local address 127.17.188.65:50151)
0811 04:49:15.738009 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:15.738048 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:15.739271 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:15.739823 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:15.739830 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:15.739915 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:15.740443 (+ 528us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:15.740444 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:15.740483 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:15.740549 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:15.740869 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:15.740878 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:15.740885 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 04:49:15.741069 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 04:49:15.741302 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":117,"threads_started":1}
I20260811 04:49:15.743343 29149 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34517
I20260811 04:49:15.743599 29149 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:15.743589 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29008
I20260811 04:49:15.743695 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:49:15.744057 18161 external_mini_cluster.cc:1428] Setting key 10e9f96005dde27caf52ef7c177b2e74
I20260811 04:49:15.744086 29149 heartbeater.cc:511] Master 127.17.188.126:34517 requested a full tablet report, sending...
I20260811 04:49:15.745731 28936 ts_manager.cc:194] Registered new tserver with Master: 14f81fde263645a9bc3f55178fb54eab (127.17.188.65:40781)
I20260811 04:49:15.746066 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--builtin_ntp_servers=127.17.188.84:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 04:49:15.855140 29152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:15.855388 29152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:15.855432 29152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:15.859273 29152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:15.859318 29152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:15.859406 29152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:49:15.864017 29152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:15.864992 29152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:15.866339 29152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:15.875644 29159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.875730 29152 server_base.cc:1034] running on GCE node
W20260811 04:49:15.875664 29158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:15.875666 29162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:15.876291 29152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:15.876947 29152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:15.878104 29152 hybrid_clock.cc:648] HybridClock initialized: now 1786423755878088 us; error 29 us; skew 500 ppm
I20260811 04:49:15.879949 29152 webserver.cc:460] Webserver started at http://127.17.188.66:43537/ using document root <none> and password file <none>
I20260811 04:49:15.880530 29152 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:15.880594 29152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:15.880851 29152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:15.882993 29152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "a08266c32193477fbc92725b51ad4d2d"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "2e0fdee10ac2cfd543be47276b6c57fc"
server_key_iv: "409efd1ad62b783d84f389fe0c7728ca"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.883553 29152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "a08266c32193477fbc92725b51ad4d2d"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "2e0fdee10ac2cfd543be47276b6c57fc"
server_key_iv: "409efd1ad62b783d84f389fe0c7728ca"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.887151 29152 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:49:15.889791 29168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.890964 29152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:15.891083 29152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "a08266c32193477fbc92725b51ad4d2d"
format_stamp: "Formatted at 2026-08-11 04:49:15 on dist-test-slave-njxd"
server_key: "2e0fdee10ac2cfd543be47276b6c57fc"
server_key_iv: "409efd1ad62b783d84f389fe0c7728ca"
server_key_version: "encryptionkey@0"
I20260811 04:49:15.891191 29152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:15.895787 29152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:15.896354 29152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:15.896528 29152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:15.897046 29152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:15.897992 29152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:15.898041 29152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.898100 29152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:15.898134 29152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:15.906710 29152 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:43847
I20260811 04:49:15.906728 29291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:43847 every 8 connection(s)
I20260811 04:49:15.907938 29152 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:49:15.912526 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29152
I20260811 04:49:15.912669 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:49:15.912995 18161 external_mini_cluster.cc:1428] Setting key 0425f4cb20e8e5ff69946d0d41467dd6
I20260811 04:49:15.914083 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.909832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:53023 (local address 127.17.188.126:34517)
0811 04:49:15.909969 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:15.909973 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:15.910997 (+ 1024us) server_negotiation.cc:407] Connection header received
0811 04:49:15.912249 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:15.912252 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:15.912297 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:15.912381 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:15.913634 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:15.913638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:15.913641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:15.913653 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:15.913676 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:15.913686 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:15.913784 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:15.913948 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 04:49:15.913984 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:49:15.915053 29294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:15.910213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34517 (local address 127.17.188.66:53023)
0811 04:49:15.910858 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:15.910896 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:15.912041 (+ 1145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:15.912549 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:15.912556 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:15.912675 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:15.913289 (+ 614us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:15.913290 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:15.913328 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:15.913421 (+ 93us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:15.913796 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:15.913805 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:15.913811 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 04:49:15.913981 (+ 170us) client_negotiation.cc:240] Negotiation successful
0811 04:49:15.914212 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":105,"threads_started":1}
I20260811 04:49:15.915350 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--builtin_ntp_servers=127.17.188.84:33665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 04:49:15.916218 29292 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34517
I20260811 04:49:15.916422 29292 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:15.916805 29292 heartbeater.cc:511] Master 127.17.188.126:34517 requested a full tablet report, sending...
I20260811 04:49:15.917830 28936 ts_manager.cc:194] Registered new tserver with Master: a08266c32193477fbc92725b51ad4d2d (127.17.188.66:43847)
W20260811 04:49:16.026605 29295 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:16.026890 29295 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:16.026968 29295 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:16.032616 29295 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:16.032707 29295 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:16.032794 29295 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:49:16.037715 29295 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34517
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29295
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:16.038880 29295 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:16.040251 29295 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:16.049605 29301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:16.049525 29300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:16.049661 29295 server_base.cc:1034] running on GCE node
W20260811 04:49:16.049525 29303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:16.050247 29295 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:16.050961 29295 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:16.052170 29295 hybrid_clock.cc:648] HybridClock initialized: now 1786423756052143 us; error 52 us; skew 500 ppm
I20260811 04:49:16.054036 29295 webserver.cc:460] Webserver started at http://127.17.188.67:35701/ using document root <none> and password file <none>
I20260811 04:49:16.054620 29295 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:16.054714 29295 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:16.054948 29295 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:16.056922 29295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "6da91814ae95445ab987c68f6f6d4903"
format_stamp: "Formatted at 2026-08-11 04:49:16 on dist-test-slave-njxd"
server_key: "99717426f54c2185c99dd8d72f87e413"
server_key_iv: "9f0034248c3d0cb875899601095a083b"
server_key_version: "encryptionkey@0"
I20260811 04:49:16.057478 29295 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "6da91814ae95445ab987c68f6f6d4903"
format_stamp: "Formatted at 2026-08-11 04:49:16 on dist-test-slave-njxd"
server_key: "99717426f54c2185c99dd8d72f87e413"
server_key_iv: "9f0034248c3d0cb875899601095a083b"
server_key_version: "encryptionkey@0"
I20260811 04:49:16.061074 29295 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:49:16.063591 29310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:16.064698 29295 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:49:16.064836 29295 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "6da91814ae95445ab987c68f6f6d4903"
format_stamp: "Formatted at 2026-08-11 04:49:16 on dist-test-slave-njxd"
server_key: "99717426f54c2185c99dd8d72f87e413"
server_key_iv: "9f0034248c3d0cb875899601095a083b"
server_key_version: "encryptionkey@0"
I20260811 04:49:16.064944 29295 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:16.069422 29295 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:16.070256 29295 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:16.070466 29295 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:16.071094 29295 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:16.072934 29295 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:16.073019 29295 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:16.073076 29295 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:16.073109 29295 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:16.085834 29295 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:40233
I20260811 04:49:16.085881 29440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:40233 every 8 connection(s)
I20260811 04:49:16.086993 29295 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:49:16.093811 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29295
I20260811 04:49:16.093937 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:49:16.094208 18161 external_mini_cluster.cc:1428] Setting key b35b5e0cdf660bafe3b7f2fd05adce39
I20260811 04:49:16.094950 28983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:16.089009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:37369 (local address 127.17.188.126:34517)
0811 04:49:16.089186 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:16.089192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:16.090578 (+ 1386us) server_negotiation.cc:407] Connection header received
0811 04:49:16.091979 (+ 1401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:16.091982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:16.092028 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:16.092106 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:16.093426 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:16.093430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:16.093432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:49:16.093446 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:16.093468 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:49:16.093485 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:16.093575 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:16.094743 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0811 04:49:16.094796 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:49:16.096246 29443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:16.089480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34517 (local address 127.17.188.67:37369)
0811 04:49:16.090395 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:16.090452 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:16.091772 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:16.092268 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:16.092274 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:16.092356 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:16.093104 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:49:16.093106 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:16.093183 (+ 77us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:49:16.093285 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:16.093570 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:16.094519 (+ 949us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:16.094525 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 04:49:16.094779 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 04:49:16.095146 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":179,"threads_started":1}
I20260811 04:49:16.097347 29441 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34517
I20260811 04:49:16.097555 29441 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:16.097973 29441 heartbeater.cc:511] Master 127.17.188.126:34517 requested a full tablet report, sending...
I20260811 04:49:16.098996 28936 ts_manager.cc:194] Registered new tserver with Master: 6da91814ae95445ab987c68f6f6d4903 (127.17.188.67:40233)
I20260811 04:49:16.108268 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 04:49:16.110921 28983 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:49:16.110171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50620 (local address 127.17.188.126:34517)
0811 04:49:16.110266 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:16.110269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:16.110478 (+ 209us) server_negotiation.cc:407] Connection header received
0811 04:49:16.110562 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:16.110564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:16.110591 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:16.110662 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:16.110834 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50620: BlockingRecv error: recv got EOF from 127.0.0.1:50620 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 04:49:16.111135 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29008
I20260811 04:49:16.123647 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29152
I20260811 04:49:16.130955 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29295
I20260811 04:49:16.137075 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 28904
2026-08-11T04:49:16Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (835 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:49:16 dist-test-slave-njxd krb5kdc[29453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:49:16 dist-test-slave-njxd krb5kdc[29453](info): set up 2 sockets
Aug 11 04:49:16 dist-test-slave-njxd krb5kdc[29453](info): commencing operation
krb5kdc: starting...
W20260811 04:49:17.226766 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:49:17 dist-test-slave-njxd krb5kdc[29453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:49:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:49:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:49:17.354774 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44469
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:49:17.467314 29467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:17.467586 29467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:17.467666 29467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:17.471580 29467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:49:17.471652 29467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:17.471688 29467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:17.471740 29467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:49:17.471774 29467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:49:17.476925 29467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:44469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:17.477931 29467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:17.478927 29467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:17.487540 29473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:17.487490 29476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:17.487663 29467 server_base.cc:1034] running on GCE node
W20260811 04:49:17.487598 29474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:17.488443 29467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:17.489511 29467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:17.490700 29467 hybrid_clock.cc:648] HybridClock initialized: now 1786423757490674 us; error 48 us; skew 500 ppm
Aug 11 04:49:17 dist-test-slave-njxd krb5kdc[29453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423757, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:49:17.493691 29467 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:49:17.494582 29467 webserver.cc:460] Webserver started at http://127.17.188.126:36273/ using document root <none> and password file <none>
I20260811 04:49:17.495143 29467 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:17.495249 29467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:17.495483 29467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:17.497501 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "7d0a64a4630e40b292003cc1ef46827d"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "6cdd6c247b8c383f57be37aa8425290b"
server_key_iv: "529bd92d3ad3cb93b5b1152f98d3c234"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.498143 29467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "7d0a64a4630e40b292003cc1ef46827d"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "6cdd6c247b8c383f57be37aa8425290b"
server_key_iv: "529bd92d3ad3cb93b5b1152f98d3c234"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.502049 29467 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:49:17.504426 29483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:17.505743 29467 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:17.505878 29467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "7d0a64a4630e40b292003cc1ef46827d"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "6cdd6c247b8c383f57be37aa8425290b"
server_key_iv: "529bd92d3ad3cb93b5b1152f98d3c234"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.505992 29467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:17.521000 29467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:17.524559 29467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:17.524783 29467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:17.532282 29467 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:44469
I20260811 04:49:17.532577 29545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:44469 every 8 connection(s)
I20260811 04:49:17.533330 29467 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:49:17.536244 29546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:17.541702 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29467
I20260811 04:49:17.541836 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:49:17.541887 29546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: Bootstrap starting.
I20260811 04:49:17.542171 18161 external_mini_cluster.cc:1428] Setting key 46f7460e51a612157d941d80ae0f0321
I20260811 04:49:17.544492 29546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:17.545276 29546 log.cc:824] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:17.547330 29546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: No bootstrap required, opened a new log
Aug 11 04:49:17 dist-test-slave-njxd krb5kdc[29453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:49:17.551687 29546 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } }
I20260811 04:49:17.551941 29546 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:17.552023 29546 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d0a64a4630e40b292003cc1ef46827d, State: Initialized, Role: FOLLOWER
I20260811 04:49:17.552467 29546 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } }
I20260811 04:49:17.552619 29546 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:49:17.552708 29546 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:49:17.552831 29546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:17.553782 29546 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } }
I20260811 04:49:17.554127 29546 leader_election.cc:302] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d0a64a4630e40b292003cc1ef46827d; no voters:
I20260811 04:49:17.554473 29546 leader_election.cc:288] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:49:17.554553 29551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:49:17.554795 29551 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [term 1 LEADER]: Becoming Leader. State: Replica: 7d0a64a4630e40b292003cc1ef46827d, State: Running, Role: LEADER
I20260811 04:49:17.555109 29551 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } }
I20260811 04:49:17.555792 29546 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:49:17.556277 29551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d0a64a4630e40b292003cc1ef46827d. Latest consensus state: current_term: 1 leader_uuid: "7d0a64a4630e40b292003cc1ef46827d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } } }
I20260811 04:49:17.556401 29551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:17.556834 29552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d0a64a4630e40b292003cc1ef46827d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d0a64a4630e40b292003cc1ef46827d" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44469 } } }
I20260811 04:49:17.556954 29552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d [sys.catalog]: This master's current role is: LEADER
I20260811 04:49:17.557423 29556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:49:17.557753 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:17.543506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.17.188.126:44469)
0811 04:49:17.543916 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:17.543933 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:17.543967 (+ 34us) server_negotiation.cc:407] Connection header received
0811 04:49:17.544585 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:17.544627 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:17.544993 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:17.545271 (+ 278us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:17.546232 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.547204 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.548343 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.548820 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.548936 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:17.551853 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:17.551858 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:17.551873 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:49:17.551902 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:17.553981 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:17.554483 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:17.554489 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:17.554495 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:17.554763 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:17.555087 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:17.555090 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:17.555092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:17.555571 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:17.555801 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:17.556081 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 04:49:17.556532 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":137,"threads_started":1}
I20260811 04:49:17.560640 29556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:49:17.566361 29556 catalog_manager.cc:1347] Generated new cluster ID: 947c740c4eda4900a87c62021b0ebab7
I20260811 04:49:17.566437 29556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:49:17.587666 29556 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:49:17.588702 29556 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:49:17.598104 29556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: Generated new TSK 0
I20260811 04:49:17.598835 29556 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:49:17.639091 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:49:17.774923 29573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:17.775202 29573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:17.775275 29573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:17.779580 29573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:17.779668 29573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:17.779760 29573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:49:17.784819 29573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:17.785883 29573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:17.786880 29573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:17.796489 29585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:17.796490 29581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:17.796536 29580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:17.796746 29573 server_base.cc:1034] running on GCE node
I20260811 04:49:17.797204 29573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:17.797897 29573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:17.799098 29573 hybrid_clock.cc:648] HybridClock initialized: now 1786423757799067 us; error 41 us; skew 500 ppm
Aug 11 04:49:17 dist-test-slave-njxd krb5kdc[29453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423757, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:49:17.802131 29573 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:49:17.802978 29573 webserver.cc:460] Webserver started at http://127.17.188.65:38005/ using document root <none> and password file <none>
I20260811 04:49:17.803576 29573 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:17.803671 29573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:17.803933 29573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:17.806018 29573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "ba8cd4686d7c4631a1a199dbf5961364"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "4d0e733056f69921b1a22c722cdb780f"
server_key_iv: "05b503e3018c9b3a2f7aa0067f0bdf83"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.806597 29573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "ba8cd4686d7c4631a1a199dbf5961364"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "4d0e733056f69921b1a22c722cdb780f"
server_key_iv: "05b503e3018c9b3a2f7aa0067f0bdf83"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.810483 29573 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:49:17.812948 29593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:17.814258 29573 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:17.814389 29573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "ba8cd4686d7c4631a1a199dbf5961364"
format_stamp: "Formatted at 2026-08-11 04:49:17 on dist-test-slave-njxd"
server_key: "4d0e733056f69921b1a22c722cdb780f"
server_key_iv: "05b503e3018c9b3a2f7aa0067f0bdf83"
server_key_version: "encryptionkey@0"
I20260811 04:49:17.814498 29573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:17.825908 29573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:17.828696 29573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:17.828912 29573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:17.829489 29573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:17.830359 29573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:17.830432 29573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:17.830502 29573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:17.830556 29573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:17.839524 29573 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:33799
I20260811 04:49:17.839545 29733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:33799 every 8 connection(s)
I20260811 04:49:17.840413 29573 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:49:17.847095 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29573
I20260811 04:49:17.847247 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:49:17.847515 18161 external_mini_cluster.cc:1428] Setting key 6724591a7cdcb30b9b88065806f15225
Aug 11 04:49:17 dist-test-slave-njxd krb5kdc[29453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423757, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:49:17.855549 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:17.842289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:45735 (local address 127.17.188.126:44469)
0811 04:49:17.842433 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:17.842437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:17.843236 (+ 799us) server_negotiation.cc:407] Connection header received
0811 04:49:17.844645 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:17.844649 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:17.844708 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:17.844833 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:17.846102 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.846643 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.847958 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.848298 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.848427 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:17.851408 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:17.851411 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:17.851414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:49:17.851439 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:17.852941 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:17.853655 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:17.853658 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:17.853660 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:17.853740 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:17.854214 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:17.854220 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:17.854225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:17.854465 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:17.854559 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:17.855235 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 04:49:17.855415 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:49:17.856784 29737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:17.842602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44469 (local address 127.17.188.65:45735)
0811 04:49:17.843048 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:17.843091 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:17.844426 (+ 1335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:17.845028 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:17.845035 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:17.845397 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:17.845946 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:17.845959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.846794 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.846797 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:17.847833 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:17.847843 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:17.848466 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:17.848470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:17.848640 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:17.849304 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:17.849321 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:17.851230 (+ 1909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:17.853071 (+ 1841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:17.853080 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:17.853098 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:17.853488 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:17.853840 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:17.853847 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:17.853852 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:17.854067 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:17.854597 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:17.854607 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:17.854950 (+ 343us) client_negotiation.cc:769] Sending connection context
0811 04:49:17.855199 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 04:49:17.855618 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":117,"threads_started":1}
I20260811 04:49:17.858336 29734 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44469
I20260811 04:49:17.858605 29734 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:49:17.859246 29734 heartbeater.cc:511] Master 127.17.188.126:44469 requested a full tablet report, sending...
I20260811 04:49:17.860741 29502 ts_manager.cc:194] Registered new tserver with Master: ba8cd4686d7c4631a1a199dbf5961364 (127.17.188.65:33799)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:49:17.862229 29502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:45735
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:49:17.876785 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:49:17.986339 29741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:17.986624 29741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:17.986702 29741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:17.990716 29741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:17.990804 29741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:17.990895 29741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:49:17.996500 29741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:17.997692 29741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:17.998797 29741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:18.008774 29749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:18.008862 29741 server_base.cc:1034] running on GCE node
W20260811 04:49:18.008776 29748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:18.009034 29751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:18.009509 29741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:18.010262 29741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:18.011451 29741 hybrid_clock.cc:648] HybridClock initialized: now 1786423758011420 us; error 46 us; skew 500 ppm
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[29453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:49:18.014225 29741 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:49:18.015126 29741 webserver.cc:460] Webserver started at http://127.17.188.66:45493/ using document root <none> and password file <none>
I20260811 04:49:18.015690 29741 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:18.015782 29741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:18.016019 29741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:18.018203 29741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "637b5492e8ad42a389f019118ea99088"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "7573d50d219811a74c298e9682fcf1fb"
server_key_iv: "158f6c8d80c570a54c3fac9b87046a2c"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.018913 29741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "637b5492e8ad42a389f019118ea99088"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "7573d50d219811a74c298e9682fcf1fb"
server_key_iv: "158f6c8d80c570a54c3fac9b87046a2c"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.022682 29741 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:49:18.025121 29760 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.026422 29741 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:49:18.026561 29741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "637b5492e8ad42a389f019118ea99088"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "7573d50d219811a74c298e9682fcf1fb"
server_key_iv: "158f6c8d80c570a54c3fac9b87046a2c"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.026674 29741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:18.053339 29741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:18.056725 29741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:18.057009 29741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:18.057791 29741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:18.058745 29741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:18.058818 29741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.058903 29741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:18.058966 29741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.067963 29741 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:45505
I20260811 04:49:18.067984 29885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:45505 every 8 connection(s)
I20260811 04:49:18.068874 29741 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:49:18.073236 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29741
I20260811 04:49:18.073351 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:49:18.073725 18161 external_mini_cluster.cc:1428] Setting key 5f59ff270bb23b8d6603a4bca8d6dbd1
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[29453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:49:18.083874 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.070747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:43359 (local address 127.17.188.126:44469)
0811 04:49:18.070883 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.070886 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.071732 (+ 846us) server_negotiation.cc:407] Connection header received
0811 04:49:18.073077 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.073080 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.073133 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.073206 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:18.074621 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.075339 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.077139 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.077348 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.077460 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.080200 (+ 2740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:18.080204 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:18.080207 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:49:18.080236 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:18.081783 (+ 1547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.082329 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.082333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.082335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.082419 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.082771 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.082776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.082777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.082959 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:18.083069 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.083562 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.083701 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
I20260811 04:49:18.084782 29888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.071142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44469 (local address 127.17.188.66:43359)
0811 04:49:18.071577 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.071620 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.072844 (+ 1224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.073396 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.073406 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.073927 (+ 521us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:18.074466 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.074478 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.075470 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.075474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.077003 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.077017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.077506 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.077511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.077733 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.078336 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:18.078352 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:18.080025 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:18.081905 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:18.081911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:18.081927 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:18.082222 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:18.082522 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:18.082526 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:18.082528 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:18.082673 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:18.083069 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:18.083077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:18.083324 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.083517 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.083839 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":117,"threads_started":1}
I20260811 04:49:18.085958 29886 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44469
I20260811 04:49:18.086236 29886 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:18.086788 29886 heartbeater.cc:511] Master 127.17.188.126:44469 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:49:18.088004 29502 ts_manager.cc:194] Registered new tserver with Master: 637b5492e8ad42a389f019118ea99088 (127.17.188.66:45505)
I20260811 04:49:18.088855 29502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:43359
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:49:18.102624 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:43053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:49:18.211938 29891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:49:18.212203 29891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:49:18.212283 29891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:49:18.216223 29891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:49:18.216301 29891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:49:18.216384 29891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:49:18.221637 29891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:43053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:49:18.222658 29891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:49:18.223667 29891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:49:18.233352 29900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:18.233345 29897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:49:18.233345 29898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:49:18.233556 29891 server_base.cc:1034] running on GCE node
I20260811 04:49:18.234005 29891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:49:18.234661 29891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:49:18.235850 29891 hybrid_clock.cc:648] HybridClock initialized: now 1786423758235830 us; error 33 us; skew 500 ppm
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[29453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:49:18.238675 29891 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:49:18.239497 29891 webserver.cc:460] Webserver started at http://127.17.188.67:36941/ using document root <none> and password file <none>
I20260811 04:49:18.240082 29891 fs_manager.cc:359] Metadata directory not provided
I20260811 04:49:18.240175 29891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:49:18.240413 29891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:49:18.242506 29891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "8fa47fcdef8f4aab856eecef32e2c70a"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "ea438c2f21bf1402d33f2075d020c4fe"
server_key_iv: "ba27e99dda7c2fd5723cf4453d26e08e"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.243091 29891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "8fa47fcdef8f4aab856eecef32e2c70a"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "ea438c2f21bf1402d33f2075d020c4fe"
server_key_iv: "ba27e99dda7c2fd5723cf4453d26e08e"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.246793 29891 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:49:18.249140 29910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.250340 29891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:49:18.250478 29891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "8fa47fcdef8f4aab856eecef32e2c70a"
format_stamp: "Formatted at 2026-08-11 04:49:18 on dist-test-slave-njxd"
server_key: "ea438c2f21bf1402d33f2075d020c4fe"
server_key_iv: "ba27e99dda7c2fd5723cf4453d26e08e"
server_key_version: "encryptionkey@0"
I20260811 04:49:18.250588 29891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:49:18.276230 29891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:49:18.279337 29891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:49:18.279544 29891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:49:18.280148 29891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:49:18.280961 29891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:49:18.281033 29891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.281101 29891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:49:18.281154 29891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:49:18.290238 29891 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:45017
I20260811 04:49:18.290266 30034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:45017 every 8 connection(s)
I20260811 04:49:18.291103 29891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:49:18.299221 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 29891
I20260811 04:49:18.299332 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:49:18.299665 18161 external_mini_cluster.cc:1428] Setting key c069a6050b953e28f9150a5ffa0aeed4
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[29453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423758, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:49:18.304545 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.292927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:40235 (local address 127.17.188.126:44469)
0811 04:49:18.293096 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.293101 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.293939 (+ 838us) server_negotiation.cc:407] Connection header received
0811 04:49:18.295275 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.295278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.295326 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.295400 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:18.296501 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.297002 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.298098 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.298305 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.298399 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.301170 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:18.301174 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:18.301176 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:49:18.301201 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:18.302833 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.303295 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.303298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.303299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.303374 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.303664 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.303666 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.303667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.303828 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:18.303903 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.304337 (+ 434us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.304428 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 04:49:18.305346 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.293306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44469 (local address 127.17.188.67:40235)
0811 04:49:18.293798 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.293841 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.295079 (+ 1238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.295560 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.295566 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.295920 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:49:18.296382 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.296393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.297101 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.297103 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.297999 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.298007 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.298443 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.298446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.298583 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.299180 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:49:18.299195 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:49:18.300978 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:49:18.302942 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:18.302946 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:18.302958 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:18.303206 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:18.303450 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:49:18.303452 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:49:18.303454 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:49:18.303577 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:49:18.303913 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:49:18.303917 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:49:18.304139 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.304291 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.304527 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":116,"threads_started":1}
I20260811 04:49:18.306433 30035 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44469
I20260811 04:49:18.306636 30035 heartbeater.cc:464] Registering TS with master...
I20260811 04:49:18.307062 30035 heartbeater.cc:511] Master 127.17.188.126:44469 requested a full tablet report, sending...
I20260811 04:49:18.307988 29502 ts_manager.cc:194] Registered new tserver with Master: 8fa47fcdef8f4aab856eecef32e2c70a (127.17.188.67:45017)
I20260811 04:49:18.308508 29502 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:40235
I20260811 04:49:18.313382 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:49:18.326030 29549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.315384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40050 (local address 127.17.188.126:44469)
0811 04:49:18.315506 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.315511 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.315659 (+ 148us) server_negotiation.cc:407] Connection header received
0811 04:49:18.315766 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.315768 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.315806 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.315876 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:49:18.316553 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.317050 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.318016 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.318228 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.318310 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.319671 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:49:18.319675 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:49:18.319677 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:49:18.319745 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:49:18.324389 (+ 4644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.324901 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.324904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.324905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.324988 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:49:18.325224 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:49:18.325226 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:49:18.325227 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:49:18.325437 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:49:18.325541 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.325812 (+ 271us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.325912 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:49:18.328763 29502 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40050:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:49:18.331863 29502 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:49:18.345844 30051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.340571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:45017 (local address 127.0.0.1:33986)
0811 04:49:18.341223 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.341237 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.341328 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.341958 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.341961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.341980 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.342055 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.342061 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.343360 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.343364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.344323 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.344333 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.345343 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.345345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.345422 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.345452 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.345534 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.345690 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":95,"threads_started":1}
I20260811 04:49:18.345851 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.340983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33986 (local address 127.17.188.67:45017)
0811 04:49:18.341445 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.341459 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.341481 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:49:18.341555 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.341560 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.341811 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.341958 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.342172 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.343207 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.344457 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.345223 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.345336 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.345480 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.345584 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.345692 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":160,"threads_started":1}
I20260811 04:49:18.346076 30047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.339903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:45505 (local address 127.0.0.1:57662)
0811 04:49:18.340990 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.341004 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.341096 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.341764 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.341767 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.341783 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.341873 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.341879 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.342914 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.342920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.344590 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.344602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.345686 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.345690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.345774 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.345795 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.345868 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.345947 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1023,"mutex_wait_us":140,"thread_start_us":110,"threads_started":1}
I20260811 04:49:18.346652 30052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.340632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57662 (local address 127.17.188.66:45505)
0811 04:49:18.341327 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.341339 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.341361 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:49:18.341429 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.341433 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.341652 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.341792 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.342006 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.342779 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.344722 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.345523 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.345649 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.345778 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.346356 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.346477 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":103,"threads_started":1}
I20260811 04:49:18.347491 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.339830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:33799 (local address 127.0.0.1:58028)
0811 04:49:18.340303 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.340349 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.340515 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.341383 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.341391 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.341441 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.341608 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.341617 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.343081 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.343084 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.344590 (+ 1506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.344602 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.346997 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.347001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.347129 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.347168 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.347252 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.347331 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":139,"thread_start_us":82,"threads_started":1}
I20260811 04:49:18.348002 30048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.339956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58028 (local address 127.17.188.65:33799)
0811 04:49:18.340340 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.340359 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.340672 (+ 313us) server_negotiation.cc:407] Connection header received
0811 04:49:18.340769 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.340776 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.340995 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.341174 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.341735 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.342940 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.345839 (+ 2899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.346706 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.346810 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.346934 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.347765 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.347868 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":99,"threads_started":1}
I20260811 04:49:18.349305 29811 tablet_service.cc:1467] Processing CreateTablet for tablet 98d108189105403798e36c47a0230ddb (DEFAULT_TABLE table=test-table [id=96e9ffe7701e49f88cbfe2b339ae4b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:49:18.349311 29960 tablet_service.cc:1467] Processing CreateTablet for tablet 98d108189105403798e36c47a0230ddb (DEFAULT_TABLE table=test-table [id=96e9ffe7701e49f88cbfe2b339ae4b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:49:18.350395 29811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d108189105403798e36c47a0230ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:18.350407 29960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d108189105403798e36c47a0230ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:18.350520 29654 tablet_service.cc:1467] Processing CreateTablet for tablet 98d108189105403798e36c47a0230ddb (DEFAULT_TABLE table=test-table [id=96e9ffe7701e49f88cbfe2b339ae4b13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:49:18.351424 29654 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 98d108189105403798e36c47a0230ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:49:18.356616 30054 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Bootstrap starting.
I20260811 04:49:18.358412 30057 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Bootstrap starting.
I20260811 04:49:18.358994 30055 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Bootstrap starting.
I20260811 04:49:18.359537 30054 tablet_bootstrap.cc:654] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:18.360268 30054 log.cc:824] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:18.360472 30057 tablet_bootstrap.cc:654] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:18.361019 30055 tablet_bootstrap.cc:654] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Neither blocks nor log segments found. Creating new log.
I20260811 04:49:18.361299 30057 log.cc:824] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:18.362226 30055 log.cc:824] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:49:18.363361 30054 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: No bootstrap required, opened a new log
I20260811 04:49:18.363564 30054 ts_tablet_manager.cc:1397] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 04:49:18.364049 30055 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: No bootstrap required, opened a new log
I20260811 04:49:18.364223 30055 ts_tablet_manager.cc:1397] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:49:18.367378 30054 raft_consensus.cc:348] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.367686 30054 raft_consensus.cc:374] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:18.367764 30054 raft_consensus.cc:729] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 637b5492e8ad42a389f019118ea99088, State: Initialized, Role: FOLLOWER
I20260811 04:49:18.367844 30055 raft_consensus.cc:348] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.368076 30055 raft_consensus.cc:374] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:18.368144 30055 raft_consensus.cc:729] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa47fcdef8f4aab856eecef32e2c70a, State: Initialized, Role: FOLLOWER
I20260811 04:49:18.368296 30057 tablet_bootstrap.cc:492] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: No bootstrap required, opened a new log
I20260811 04:49:18.368264 30054 consensus_queue.cc:260] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.368492 30057 ts_tablet_manager.cc:1397] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260811 04:49:18.368548 30055 consensus_queue.cc:260] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.369232 30035 heartbeater.cc:503] Master 127.17.188.126:44469 was elected leader, sending a full tablet report...
I20260811 04:49:18.369457 30055 ts_tablet_manager.cc:1428] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260811 04:49:18.369814 30054 ts_tablet_manager.cc:1428] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:49:18.370203 29886 heartbeater.cc:503] Master 127.17.188.126:44469 was elected leader, sending a full tablet report...
I20260811 04:49:18.372746 30057 raft_consensus.cc:348] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.373005 30057 raft_consensus.cc:374] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:49:18.373073 30057 raft_consensus.cc:729] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba8cd4686d7c4631a1a199dbf5961364, State: Initialized, Role: FOLLOWER
I20260811 04:49:18.373492 30057 consensus_queue.cc:260] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.374164 29734 heartbeater.cc:503] Master 127.17.188.126:44469 was elected leader, sending a full tablet report...
I20260811 04:49:18.374468 30057 ts_tablet_manager.cc:1428] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
W20260811 04:49:18.542133 30036 tablet.cc:2369] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:49:18.570151 29887 tablet.cc:2369] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:49:18.591259 30063 raft_consensus.cc:482] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:49:18.591579 30063 raft_consensus.cc:504] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
W20260811 04:49:18.591796 29736 tablet.cc:2369] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:49:18.593358 30063 leader_election.cc:288] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 637b5492e8ad42a389f019118ea99088 (127.17.188.66:45505), 8fa47fcdef8f4aab856eecef32e2c70a (127.17.188.67:45017)
I20260811 04:49:18.595309 30062 raft_consensus.cc:482] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:49:18.595481 30062 raft_consensus.cc:504] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.596477 30062 leader_election.cc:288] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba8cd4686d7c4631a1a199dbf5961364 (127.17.188.65:33799), 637b5492e8ad42a389f019118ea99088 (127.17.188.66:45505)
I20260811 04:49:18.598656 30052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.594171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:47937 (local address 127.17.188.66:45505)
0811 04:49:18.594287 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.594291 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.594313 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:49:18.594379 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.594384 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.594434 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.594512 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.594841 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.595403 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.597235 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.597849 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.597942 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.598000 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.598440 (+ 440us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.598522 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 04:49:18.598678 30053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.593885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:52425 (local address 127.17.188.67:45017)
0811 04:49:18.594020 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.594027 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.594047 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:49:18.594248 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.594254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.594317 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.594378 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.594727 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.595378 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.597234 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.597849 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.597942 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.598043 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.598477 (+ 434us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.598547 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":54}
I20260811 04:49:18.599000 30065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.593766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:45505 (local address 127.17.188.65:47937)
0811 04:49:18.594061 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.594074 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.594185 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.594553 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.594556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.594571 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.594712 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.594719 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.595542 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.595545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.597081 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.597092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.598120 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.598123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.598285 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.598310 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.598784 (+ 474us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.598859 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":178,"thread_start_us":81,"threads_started":1}
I20260811 04:49:18.599447 30064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.593622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:45017 (local address 127.17.188.65:52425)
0811 04:49:18.593970 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.593985 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.594107 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.594415 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.594419 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.594436 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.594605 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.594614 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.595494 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.595500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.597081 (+ 1581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.597092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.598115 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.598119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.598335 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.598362 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.599233 (+ 871us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.599307 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"mutex_wait_us":201,"thread_start_us":127,"threads_started":1}
I20260811 04:49:18.600042 29986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "ba8cd4686d7c4631a1a199dbf5961364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" is_pre_election: true
I20260811 04:49:18.600238 29986 raft_consensus.cc:2454] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba8cd4686d7c4631a1a199dbf5961364 in term 0.
I20260811 04:49:18.600215 29833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "ba8cd4686d7c4631a1a199dbf5961364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "637b5492e8ad42a389f019118ea99088" is_pre_election: true
I20260811 04:49:18.600485 29833 raft_consensus.cc:2454] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba8cd4686d7c4631a1a199dbf5961364 in term 0.
I20260811 04:49:18.600978 29594 leader_election.cc:302] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa47fcdef8f4aab856eecef32e2c70a, ba8cd4686d7c4631a1a199dbf5961364; no voters:
I20260811 04:49:18.601436 30063 raft_consensus.cc:2781] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:49:18.601531 30063 raft_consensus.cc:482] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:49:18.601557 30066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.596855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:45505 (local address 127.17.188.67:56051)
0811 04:49:18.597149 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.597172 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.597262 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.597903 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.597906 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.597924 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.598302 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.598312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.599259 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.599262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.600322 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.600331 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.601212 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.601217 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.601324 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.601344 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.601385 (+ 41us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.601432 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":227,"thread_start_us":116,"threads_started":1}
I20260811 04:49:18.601608 30063 raft_consensus.cc:3037] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:18.601809 30048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.597264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:35305 (local address 127.17.188.65:33799)
0811 04:49:18.597674 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.597679 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.597693 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:49:18.597735 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.597738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.597777 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.597854 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.598260 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.598956 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.600457 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.601012 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.601119 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.601170 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.601631 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.601703 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313}
I20260811 04:49:18.602054 30037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.596594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:33799 (local address 127.17.188.67:35305)
0811 04:49:18.596677 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.596691 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:49:18.596768 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:49:18.597958 (+ 1190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:49:18.597960 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:49:18.597972 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:49:18.598139 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.598145 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.599146 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.599160 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.600312 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:49:18.600324 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.601233 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.601237 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:49:18.601345 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.601366 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:49:18.601441 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 04:49:18.601517 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26,"mutex_wait_us":67}
I20260811 04:49:18.602078 30067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.597398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:56051 (local address 127.17.188.66:45505)
0811 04:49:18.597686 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.597691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.597704 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:49:18.597741 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.597744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.597783 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.598027 (+ 244us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:49:18.598443 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.599128 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.600478 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.601080 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.601779 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.601830 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.601883 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.601958 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":102,"threads_started":1}
I20260811 04:49:18.602569 29677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba8cd4686d7c4631a1a199dbf5961364" is_pre_election: true
I20260811 04:49:18.602923 30063 raft_consensus.cc:504] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.603205 29677 raft_consensus.cc:2379] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fa47fcdef8f4aab856eecef32e2c70a in current term 1: Already voted for candidate ba8cd4686d7c4631a1a199dbf5961364 in this term.
I20260811 04:49:18.603307 30063 leader_election.cc:288] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [CANDIDATE]: Term 1 election: Requested vote from peers 637b5492e8ad42a389f019118ea99088 (127.17.188.66:45505), 8fa47fcdef8f4aab856eecef32e2c70a (127.17.188.67:45017)
I20260811 04:49:18.603619 29833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "ba8cd4686d7c4631a1a199dbf5961364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "637b5492e8ad42a389f019118ea99088"
I20260811 04:49:18.603737 29833 raft_consensus.cc:3037] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:18.603837 29832 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "637b5492e8ad42a389f019118ea99088" is_pre_election: true
I20260811 04:49:18.604053 29986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98d108189105403798e36c47a0230ddb" candidate_uuid: "ba8cd4686d7c4631a1a199dbf5961364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa47fcdef8f4aab856eecef32e2c70a"
I20260811 04:49:18.604167 29986 raft_consensus.cc:3037] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:49:18.604383 29912 leader_election.cc:302] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa47fcdef8f4aab856eecef32e2c70a; no voters: 637b5492e8ad42a389f019118ea99088, ba8cd4686d7c4631a1a199dbf5961364
I20260811 04:49:18.605118 29833 raft_consensus.cc:2454] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba8cd4686d7c4631a1a199dbf5961364 in term 1.
I20260811 04:49:18.605429 29595 leader_election.cc:302] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 637b5492e8ad42a389f019118ea99088, ba8cd4686d7c4631a1a199dbf5961364; no voters:
I20260811 04:49:18.605456 29986 raft_consensus.cc:2454] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba8cd4686d7c4631a1a199dbf5961364 in term 1.
I20260811 04:49:18.605558 30062 raft_consensus.cc:2726] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 04:49:18.605952 30063 raft_consensus.cc:2781] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:49:18.606189 30063 raft_consensus.cc:686] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [term 1 LEADER]: Becoming Leader. State: Replica: ba8cd4686d7c4631a1a199dbf5961364, State: Running, Role: LEADER
I20260811 04:49:18.606506 30063 consensus_queue.cc:237] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } }
I20260811 04:49:18.609437 29502 catalog_manager.cc:5495] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba8cd4686d7c4631a1a199dbf5961364 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "ba8cd4686d7c4631a1a199dbf5961364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba8cd4686d7c4631a1a199dbf5961364" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 33799 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 } health_report { overall_health: UNKNOWN } } }
I20260811 04:49:18.636031 30048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.632755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58038 (local address 127.17.188.65:33799)
0811 04:49:18.632885 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 04:49:18.632889 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:49:18.632903 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:49:18.633003 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:49:18.633006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:49:18.633060 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:49:18.633167 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:49:18.633391 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.633929 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.634768 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:49:18.634977 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:49:18.635051 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:49:18.635319 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:49:18.635730 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:49:18.635821 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 04:49:18.635875 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 04:49:18.635922 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 04:49:18.642216 29833 raft_consensus.cc:1261] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 1 FOLLOWER]: Refusing update from remote peer ba8cd4686d7c4631a1a199dbf5961364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:49:18.642263 29986 raft_consensus.cc:1261] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 1 FOLLOWER]: Refusing update from remote peer ba8cd4686d7c4631a1a199dbf5961364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:49:18.642926 30063 consensus_queue.cc:1035] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "637b5492e8ad42a389f019118ea99088" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:49:18.643133 30068 consensus_queue.cc:1035] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa47fcdef8f4aab856eecef32e2c70a" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 45017 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:49:18.650435 30073 mvcc.cc:205] Tried to move back new op lower bound from 7317191715391037440 to 7317191715254530048. Current Snapshot: MvccSnapshot[applied={T|T < 7317191715391037440}]
I20260811 04:49:18.651958 30075 mvcc.cc:205] Tried to move back new op lower bound from 7317191715391037440 to 7317191715254530048. Current Snapshot: MvccSnapshot[applied={T|T < 7317191715391037440}]
I20260811 04:49:18.659298 29502 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:49:18.659466 29502 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40050:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:49:18.662048 29502 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7d0a64a4630e40b292003cc1ef46827d: Sending DeleteTablet for 3 replicas of tablet 98d108189105403798e36c47a0230ddb
I20260811 04:49:18.662964 29811 tablet_service.cc:1514] Processing DeleteTablet for tablet 98d108189105403798e36c47a0230ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:49:18 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:57662
I20260811 04:49:18.662940 29654 tablet_service.cc:1514] Processing DeleteTablet for tablet 98d108189105403798e36c47a0230ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:49:18 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58028
I20260811 04:49:18.663498 30082 tablet_replica.cc:330] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: stopping tablet replica
I20260811 04:49:18.663661 29960 tablet_service.cc:1514] Processing DeleteTablet for tablet 98d108189105403798e36c47a0230ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:49:18 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:33986
I20260811 04:49:18.663759 30083 tablet_replica.cc:330] T 98d108189105403798e36c47a0230ddb P ba8cd4686d7c4631a1a199dbf5961364: stopping tablet replica
I20260811 04:49:18.664093 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29573
I20260811 04:49:18.664130 30084 tablet_replica.cc:330] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: stopping tablet replica
I20260811 04:49:18.664435 30082 raft_consensus.cc:2229] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:49:18.665444 30082 raft_consensus.cc:2258] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:49:18.667659 30084 raft_consensus.cc:2229] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:49:18.668004 30084 raft_consensus.cc:2258] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:49:18.669772 30084 ts_tablet_manager.cc:1905] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:49:18.670117 30082 ts_tablet_manager.cc:1905] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:49:18.672361 30082 ts_tablet_manager.cc:1918] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:49:18.672497 30082 log.cc:1196] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/98d108189105403798e36c47a0230ddb
I20260811 04:49:18.672835 30082 ts_tablet_manager.cc:1939] T 98d108189105403798e36c47a0230ddb P 637b5492e8ad42a389f019118ea99088: Deleting consensus metadata
I20260811 04:49:18.673302 30084 ts_tablet_manager.cc:1918] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:49:18.673408 30084 log.cc:1196] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/98d108189105403798e36c47a0230ddb
I20260811 04:49:18.673772 30084 ts_tablet_manager.cc:1939] T 98d108189105403798e36c47a0230ddb P 8fa47fcdef8f4aab856eecef32e2c70a: Deleting consensus metadata
I20260811 04:49:18.674209 29485 catalog_manager.cc:4841] TS 637b5492e8ad42a389f019118ea99088 (127.17.188.66:45505): tablet 98d108189105403798e36c47a0230ddb (table test-table [id=96e9ffe7701e49f88cbfe2b339ae4b13]) successfully deleted
I20260811 04:49:18.675014 29484 catalog_manager.cc:4841] TS 8fa47fcdef8f4aab856eecef32e2c70a (127.17.188.67:45017): tablet 98d108189105403798e36c47a0230ddb (table test-table [id=96e9ffe7701e49f88cbfe2b339ae4b13]) successfully deleted
W20260811 04:49:18.675534 29484 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:33799 (error 108)
I20260811 04:49:18.676357 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29741
I20260811 04:49:18.676651 30046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:49:18.676311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:33799 (local address 127.0.0.1:58050)
0811 04:49:18.676472 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 04:49:18.676553 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:33799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 04:49:18.682108 29484 catalog_manager.cc:4584] TS ba8cd4686d7c4631a1a199dbf5961364 (127.17.188.65:33799): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 98d108189105403798e36c47a0230ddb: Network error: Client connection negotiation failed: client connection to 127.17.188.65:33799: connect: Connection refused (error 111)
I20260811 04:49:18.683673 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29891
I20260811 04:49:18.691838 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 29467
2026-08-11T04:49:18Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2556 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[30089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[30089](info): set up 2 sockets
Aug 11 04:49:18 dist-test-slave-njxd krb5kdc[30089](info): commencing operation
krb5kdc: starting...
W20260811 04:49:19.775882 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:49:19 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:49:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:49:19Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangeradmin_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangeradmin_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangerlookup_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangerlookup_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
I20260811 04:49:19.944380 18161 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9CJn4q/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/postgres -l logfile start
2026-08-11 04:49:22.322 UTC [30122] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 04:49:22.322 UTC [30122] LOG: listening on IPv4 address "127.17.188.84", port 34815
2026-08-11 04:49:22.325 UTC [30122] LOG: listening on Unix socket "/tmp/.s.PGSQL.34815"
2026-08-11 04:49:22.362 UTC [30125] LOG: database system was shut down at 2026-08-11 04:49:21 UTC
2026-08-11 04:49:22.366 UTC [30122] LOG: database system is ready to accept connections
I20260811 04:49:23.364341 18161 mini_postgres.cc:96] Postgres bound to 34815
2026-08-11 04:49:23.372 UTC [30134] FATAL: database "slave" does not exist
127.17.188.84:34815 - accepting connections
I20260811 04:49:23.373036 18161 mini_ranger.cc:161] Starting Ranger...
I20260811 04:49:23.389231 18161 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 04:49:23.866336 18161 mini_ranger.cc:87] Created ranger Postgres database
I20260811 04:49:23.866438 18161 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin
2026-08-11 04:49:24,173 [I] DB FLAVOR :POSTGRES
2026-08-11 04:49:24,173 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 04:49:24,173 [I] Checking connection..
2026-08-11 04:49:24,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 04:49:24,439 [I] Checking connection passed.
2026-08-11 04:49:24,439 [I] --------- Verifying version history table ---------
2026-08-11 04:49:24,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:49:24,710 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 04:49:24,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:49:24,940 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 04:49:24,940 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 04:49:24,941 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 04:49:25.184 UTC [30210] WARNING: there is no transaction in progress
2026-08-11 04:49:25,191 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 04:49:25,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:49:25,440 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 04:49:25,440 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 04:49:25,440 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 04:49:25,675 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 04:49:25,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-11 04:49:26,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 04:49:26,413 [I] Table x_portal_user does not exist in database ranger
2026-08-11 04:49:26,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 04:49:26,656 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 04:49:26,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 04:49:26,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 04:49:27,158 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 04:49:27,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 04:49:28.098 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.114 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.129 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.144 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.158 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.175 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.226 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.232 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.246 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.255 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.265 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.279 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.289 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.295 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.301 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28.308 UTC [30332] WARNING: there is no transaction in progress
2026-08-11 04:49:28,921 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 04:49:28,921 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 04:49:29,176 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 04:49:29,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 04:49:29,434 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 04:49:29,434 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 04:49:29,668 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 04:49:29,668 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 04:49:29,915 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 04:49:30,154 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-11 04:49:30,405 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 04:49:30,405 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 04:49:30,651 [I] DB_PATCHES have already been applied
I20260811 04:49:30.657333 18161 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9CJn4q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 04:49:30.657402 18161 mini_ranger.cc:193] Using host: 127.17.188.84
I20260811 04:49:30.661852 18161 mini_ranger.cc:227] Ranger admin URL: http://127.17.188.84:59669
Aug 11, 2026 4:49:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:49:30 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:49:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:49:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:49:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:49:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:49:31 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 04:49:31.820075 18161 mini_ranger.cc:160] Time spent starting Ranger: real 8.447s user 0.000s sys 0.012s
Aug 11, 2026 4:49:55 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:49:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 4:49:55 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:49:55 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:49:56 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 04:49:57.407793 18161 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangerkms_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/rangerkms_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.188.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.188.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 04:49:57 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423797, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 04:49:57.503000 18161 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 04:49:57.515188 18161 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 04:49:58.417527 18161 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 04:49:58.417793 18161 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms
I20260811 04:49:58.417914 18161 mini_ranger_kms.cc:227] Using postgres at 127.17.188.84:34815
2026-08-11 04:49:59,103 [I] DB FLAVOR :POSTGRES
2026-08-11 04:49:59,103 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 04:49:59,103 [I] Checking connection
2026-08-11 04:49:59,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 04:49:59,453 [I] connection success
2026-08-11 04:49:59,454 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 04:49:59,454 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 04:49:59,454 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 04:49:59,695 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 04:49:59,696 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 04:49:59,696 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 04:49:59,696 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:34815/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 04:49:59,963 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 04:50:00.434163 18161 mini_ranger_kms.cc:310] Created kms service
I20260811 04:50:00.662309 18161 mini_ranger_kms.cc:326] Created kudu user
I20260811 04:50:00.707072 18161 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 04:50:00 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423797, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:01.105120 18161 mini_ranger_kms.cc:384] Added ranger policy
I20260811 04:50:01.105293 18161 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms:/tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 04:50:01.105317 18161 mini_ranger_kms.cc:240] Using host: 127.17.188.84
I20260811 04:50:01.109891 18161 mini_ranger_kms.cc:276] Ranger KMS PID: 30540
I20260811 04:50:01.110031 18161 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.188.84:53029
Aug 11, 2026 4:50:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:50:02 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:50:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:50:02 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:50:03 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:50:03 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 04:50:03.506284 18161 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.003s user 0.000s sys 0.654s
I20260811 04:50:03.506433 18161 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 04:50:03.506565 18161 mini_ranger_kms.cc:401] 127.17.188.84:53029/kms/v1/keys
Aug 11 04:50:03 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786423803, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 04:50:04 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423803, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
Aug 11 04:50:04 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423803, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
Aug 11 04:50:07 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:50:07.229204 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41981
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41981
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:53029/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:07.388505 30598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:07.388779 30598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:07.388845 30598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:07.393191 30598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:50:07.393253 30598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:07.393273 30598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:07.393322 30598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:50:07.393358 30598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:50:07.399348 30598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.188.84:53029/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41981
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:07.400388 30598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:07.401425 30598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:07.412406 30604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:07.412508 30606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:07.412832 30608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:07.412869 30598 server_base.cc:1034] running on GCE node
I20260811 04:50:07.413497 30598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:07.414956 30598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:07.416139 30598 hybrid_clock.cc:648] HybridClock initialized: now 1786423807416099 us; error 50 us; skew 500 ppm
Aug 11 04:50:07 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423807, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:07.419926 30598 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:50:07.420882 30598 webserver.cc:460] Webserver started at http://127.17.188.126:42761/ using document root <none> and password file <none>
I20260811 04:50:07.421417 30598 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:07.421471 30598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:07.421729 30598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:07 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423807, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:07.488848 30598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "b9be4f42c89e416a8266b59d585b8983"
format_stamp: "Formatted at 2026-08-11 04:50:07 on dist-test-slave-njxd"
server_key: "ac7092e5294cb5413bb4daed114a98e2"
server_key_iv: "10598c16b561b368ceabda7ff0a4dfa8"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:07.489691 30598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "b9be4f42c89e416a8266b59d585b8983"
format_stamp: "Formatted at 2026-08-11 04:50:07 on dist-test-slave-njxd"
server_key: "ac7092e5294cb5413bb4daed114a98e2"
server_key_iv: "10598c16b561b368ceabda7ff0a4dfa8"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:07.494251 30598 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:50:07.514071 30617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:07.515631 30598 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 04:50:07.515781 30598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "b9be4f42c89e416a8266b59d585b8983"
format_stamp: "Formatted at 2026-08-11 04:50:07 on dist-test-slave-njxd"
server_key: "ac7092e5294cb5413bb4daed114a98e2"
server_key_iv: "10598c16b561b368ceabda7ff0a4dfa8"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:07.515919 30598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:07.530678 30598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:07.534278 30598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:07.534575 30598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:07.553687 30598 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:41981
I20260811 04:50:07.553815 30679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:41981 every 8 connection(s)
I20260811 04:50:07.555135 30598 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:50:07.558454 30680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:07.558820 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 30598
I20260811 04:50:07.558965 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:50:07.559286 18161 external_mini_cluster.cc:1428] Setting key 865ab8cf03669f6b119ef0c73b60b2c8
I20260811 04:50:07.567818 30680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: Bootstrap starting.
I20260811 04:50:07.571430 30680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:07.572927 30680 log.cc:824] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: Log is configured to *not* fsync() on all Append() calls
Aug 11 04:50:07 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423807, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:07.575798 30680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: No bootstrap required, opened a new log
I20260811 04:50:07.581071 30680 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } }
I20260811 04:50:07.581321 30683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:07.561013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52138 (local address 127.17.188.126:41981)
0811 04:50:07.561874 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:07.561903 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:07.561954 (+ 51us) server_negotiation.cc:407] Connection header received
0811 04:50:07.563676 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:07.563714 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:07.564233 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:07.564675 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:07.565812 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:07.567751 (+ 1939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:07.569025 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:07.569961 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:07.570143 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:07.574096 (+ 3953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:07.574105 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:07.574123 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:07.574162 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:07.577496 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:07.578129 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:07.578135 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:07.578142 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:07.578329 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:07.578692 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:07.578696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:07.578697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:07.579242 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:07.579467 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:07.579868 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 04:50:07.580278 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":617,"thread_start_us":315,"threads_started":1}
I20260811 04:50:07.581355 30680 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:07.581403 30680 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9be4f42c89e416a8266b59d585b8983, State: Initialized, Role: FOLLOWER
I20260811 04:50:07.582020 30680 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } }
I20260811 04:50:07.582190 30680 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:50:07.582286 30680 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:50:07.582391 30680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:07.583602 30680 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } }
I20260811 04:50:07.583956 30680 leader_election.cc:302] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9be4f42c89e416a8266b59d585b8983; no voters:
I20260811 04:50:07.584372 30680 leader_election.cc:288] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:50:07.584542 30686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:50:07.584880 30686 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [term 1 LEADER]: Becoming Leader. State: Replica: b9be4f42c89e416a8266b59d585b8983, State: Running, Role: LEADER
I20260811 04:50:07.585330 30686 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } }
I20260811 04:50:07.585909 30680 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:50:07.587488 30688 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9be4f42c89e416a8266b59d585b8983. Latest consensus state: current_term: 1 leader_uuid: "b9be4f42c89e416a8266b59d585b8983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } } }
I20260811 04:50:07.587667 30688 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:07.588413 30689 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9be4f42c89e416a8266b59d585b8983" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9be4f42c89e416a8266b59d585b8983" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41981 } } }
I20260811 04:50:07.588574 30689 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:07.588627 30696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:50:07.592384 30696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:50:07.592947 30680 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 04:50:07.615553 30696 catalog_manager.cc:1347] Generated new cluster ID: 8d53b95cf0ca4287949982fa7e9d5157
I20260811 04:50:07.615631 30696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:50:07.648696 30696 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:50:07.650451 30696 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:50:07.674007 30696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: Generated new TSK 0
I20260811 04:50:07.675374 30696 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:50:08.640995 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:53029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:08.824985 30731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:08.825289 30731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:08.825380 30731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:08.829509 30731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:08.829625 30731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:08.829733 30731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:50:08.835234 30731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.188.84:53029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:08.836292 30731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:08.837343 30731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:08.850777 30742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:08.851047 30740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:08.850831 30738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:08.851477 30731 server_base.cc:1034] running on GCE node
I20260811 04:50:08.851986 30731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:08.852847 30731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:08.854053 30731 hybrid_clock.cc:648] HybridClock initialized: now 1786423808854032 us; error 33 us; skew 500 ppm
Aug 11 04:50:08 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423808, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:08.858021 30731 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:50:08.859123 30731 webserver.cc:460] Webserver started at http://127.17.188.65:33419/ using document root <none> and password file <none>
I20260811 04:50:08.859846 30731 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:08.859972 30731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:08.860244 30731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:08 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423808, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:08.878575 30731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "6e32f1fb62b74606a1e4fdaef58ff349"
format_stamp: "Formatted at 2026-08-11 04:50:08 on dist-test-slave-njxd"
server_key: "ae9d943deeaddc79c8f8a1e111f50443"
server_key_iv: "3c2aeba0eadb3ec5a96676d53211d1d0"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:08.879347 30731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "6e32f1fb62b74606a1e4fdaef58ff349"
format_stamp: "Formatted at 2026-08-11 04:50:08 on dist-test-slave-njxd"
server_key: "ae9d943deeaddc79c8f8a1e111f50443"
server_key_iv: "3c2aeba0eadb3ec5a96676d53211d1d0"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:08.883584 30731 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 04:50:08.899614 30751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:08.901407 30731 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260811 04:50:08.901530 30731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "6e32f1fb62b74606a1e4fdaef58ff349"
format_stamp: "Formatted at 2026-08-11 04:50:08 on dist-test-slave-njxd"
server_key: "ae9d943deeaddc79c8f8a1e111f50443"
server_key_iv: "3c2aeba0eadb3ec5a96676d53211d1d0"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:08.901728 30731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:08.918978 30731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:08.922976 30731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:08.923264 30731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:08.924265 30731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:08.925884 30731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:08.925997 30731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:08.926149 30731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:08.926244 30731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:08.955832 30731 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:39663
I20260811 04:50:08.957286 30731 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:50:08.962502 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 30731
I20260811 04:50:08.962641 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:50:08.962975 18161 external_mini_cluster.cc:1428] Setting key 84b7be17c487f653e2d28bcb3bdf2e69
I20260811 04:50:08.969286 30878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:39663 every 8 connection(s)
Aug 11 04:50:08 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423808, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:50:09.004801 30884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:08.972074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41981 (local address 127.17.188.65:35891)
0811 04:50:08.977798 (+ 5724us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:08.977863 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:08.979047 (+ 1184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:08.986532 (+ 7485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:08.986542 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:08.987468 (+ 926us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:08.988435 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:08.988459 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:08.989793 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:08.989796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:08.991318 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:08.991329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:08.992065 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:08.992070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:08.992366 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:08.993288 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:08.993312 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:08.995628 (+ 2316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:08.999469 (+ 3841us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:08.999475 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:08.999493 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:08.999860 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.000316 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:09.000320 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:09.000322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:09.000530 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.001155 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:09.001162 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:09.001546 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 04:50:09.003183 (+ 1637us) client_negotiation.cc:240] Negotiation successful
0811 04:50:09.003580 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5422,"thread_start_us":244,"threads_started":1}
I20260811 04:50:09.005651 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:08.973376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35891 (local address 127.17.188.126:41981)
0811 04:50:08.985819 (+ 12443us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:08.985824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:08.985843 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:50:08.985894 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:08.985897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:08.985950 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:08.988609 (+ 2659us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:08.988738 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:08.989641 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:08.991511 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:08.991853 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:08.991970 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:08.997150 (+ 5180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:08.997155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:08.997158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:08.997189 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:08.999316 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.000007 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.000011 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.000013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.000176 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.000685 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.000688 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.000689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.000939 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:09.001042 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:09.005200 (+ 4158us) server_negotiation.cc:299] Negotiation successful
0811 04:50:09.005384 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12347,"thread_start_us":141,"threads_started":1}
I20260811 04:50:09.008062 30880 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41981
I20260811 04:50:09.008381 30880 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:09.009215 30880 heartbeater.cc:511] Master 127.17.188.126:41981 requested a full tablet report, sending...
I20260811 04:50:09.011193 30637 ts_manager.cc:194] Registered new tserver with Master: 6e32f1fb62b74606a1e4fdaef58ff349 (127.17.188.65:39663)
I20260811 04:50:09.013016 30637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:35891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:50:09.040105 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:53029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 04:50:09.264757 30889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:09.265296 30889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:09.265472 30889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:09.270053 30889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:09.270138 30889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:09.270229 30889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:50:09.278136 30889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.188.84:53029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:09.279510 30889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:09.280915 30889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:09.295836 30897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:09.295838 30899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:09.296715 30896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:09.296801 30889 server_base.cc:1034] running on GCE node
I20260811 04:50:09.297540 30889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:09.298555 30889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:09.299903 30889 hybrid_clock.cc:648] HybridClock initialized: now 1786423809299873 us; error 63 us; skew 500 ppm
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:09.305006 30889 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:50:09.306277 30889 webserver.cc:460] Webserver started at http://127.17.188.66:36621/ using document root <none> and password file <none>
I20260811 04:50:09.307008 30889 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:09.307098 30889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:09.307337 30889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:09.329842 30889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "2aeb2f5b3b774201a6b183362f250366"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "033497c360fcf679da1fc46925baccbd"
server_key_iv: "b5c6a122e2e3096e40803e1a82944f96"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.330794 30889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "2aeb2f5b3b774201a6b183362f250366"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "033497c360fcf679da1fc46925baccbd"
server_key_iv: "b5c6a122e2e3096e40803e1a82944f96"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.337620 30889 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 04:50:09.358944 30907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.360821 30889 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.004s sys 0.000s
I20260811 04:50:09.360975 30889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "2aeb2f5b3b774201a6b183362f250366"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "033497c360fcf679da1fc46925baccbd"
server_key_iv: "b5c6a122e2e3096e40803e1a82944f96"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.361135 30889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:09.380486 30889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:09.384915 30889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:09.385138 30889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:09.386024 30889 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:09.387421 30889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:09.387486 30889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.387718 30889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:09.387770 30889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.414361 30889 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:40359
I20260811 04:50:09.416471 30889 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:50:09.425623 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 30889
I20260811 04:50:09.425817 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:50:09.426318 18161 external_mini_cluster.cc:1428] Setting key 291ebde94ad6dc53f035ee430f90e697
I20260811 04:50:09.428355 31033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:40359 every 8 connection(s)
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:09.462227 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:09.437828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:49295 (local address 127.17.188.126:41981)
0811 04:50:09.437990 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:09.437995 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:09.438741 (+ 746us) server_negotiation.cc:407] Connection header received
0811 04:50:09.440029 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:09.440033 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:09.440089 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:09.440190 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:09.443052 (+ 2862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.443843 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.452915 (+ 9072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.453301 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.453398 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:09.457352 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:09.457356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:09.457359 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:09.457389 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:09.459268 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.460017 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.460021 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.460023 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.460129 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.460558 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.460574 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.460576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.460848 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:09.460953 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:09.461795 (+ 842us) server_negotiation.cc:299] Negotiation successful
0811 04:50:09.461974 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:50:09.464643 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:09.436670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41981 (local address 127.17.188.66:49295)
0811 04:50:09.438596 (+ 1926us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:09.438646 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:09.439810 (+ 1164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:09.441340 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:09.441351 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:09.441986 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:09.442865 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:09.442888 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.444025 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.444029 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:09.452715 (+ 8686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:09.452735 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.453673 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.453677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:09.453973 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:09.454893 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:09.454917 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:09.457120 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:09.459429 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:09.459435 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:09.459457 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:09.459883 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.460253 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:09.460257 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:09.460259 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:09.460446 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.461042 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:09.461048 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:09.461459 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 04:50:09.462954 (+ 1495us) client_negotiation.cc:240] Negotiation successful
0811 04:50:09.463452 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1698,"thread_start_us":296,"threads_started":1}
I20260811 04:50:09.466835 31035 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41981
I20260811 04:50:09.467103 31035 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:09.467680 31035 heartbeater.cc:511] Master 127.17.188.126:41981 requested a full tablet report, sending...
I20260811 04:50:09.468861 30637 ts_manager.cc:194] Registered new tserver with Master: 2aeb2f5b3b774201a6b183362f250366 (127.17.188.66:40359)
I20260811 04:50:09.469740 30637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:49295
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:50:09.493697 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:53029/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:09.690568 31041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:09.690881 31041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:09.691057 31041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:09.695202 31041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:09.695282 31041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:09.695396 31041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:50:09.705698 31041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.188.84:53029/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:41981
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:09.707298 31041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:09.708701 31041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:09.729616 31047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:09.730132 31046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:09.731444 31051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:09.731817 31041 server_base.cc:1034] running on GCE node
I20260811 04:50:09.732592 31041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:09.733479 31041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:09.736788 31041 hybrid_clock.cc:648] HybridClock initialized: now 1786423809736691 us; error 102 us; skew 500 ppm
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:09.743492 31041 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:50:09.744778 31041 webserver.cc:460] Webserver started at http://127.17.188.67:34993/ using document root <none> and password file <none>
I20260811 04:50:09.745607 31041 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:09.745734 31041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:09.746024 31041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:09.765278 31041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "8329d9600b084265bd116d51014690d3"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "f30eedf28eb799a1ff5c20857b4bf72b"
server_key_iv: "ec50c2d12037e78aebfdbf94179a6c4a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.766716 31041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "8329d9600b084265bd116d51014690d3"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "f30eedf28eb799a1ff5c20857b4bf72b"
server_key_iv: "ec50c2d12037e78aebfdbf94179a6c4a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.776397 31041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 04:50:09.802436 31059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.805500 31041 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260811 04:50:09.805780 31041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "8329d9600b084265bd116d51014690d3"
format_stamp: "Formatted at 2026-08-11 04:50:09 on dist-test-slave-njxd"
server_key: "f30eedf28eb799a1ff5c20857b4bf72b"
server_key_iv: "ec50c2d12037e78aebfdbf94179a6c4a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:09.806001 31041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:09.834049 31041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:09.844295 31041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:09.845255 31041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:09.846812 31041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:09.848361 31041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:09.848474 31041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.848619 31041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:09.848688 31041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:09.884434 31041 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:42435
I20260811 04:50:09.886049 31041 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:50:09.892527 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 31041
I20260811 04:50:09.892654 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:50:09.892963 18161 external_mini_cluster.cc:1428] Setting key d924c7d8a49db38bd5760aaf5161dd01
I20260811 04:50:09.889415 31182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:42435 every 8 connection(s)
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:09.925823 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:09.897727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:34733 (local address 127.17.188.126:41981)
0811 04:50:09.897835 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:09.897839 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:09.897851 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:50:09.897889 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:09.897891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:09.897934 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:09.898011 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:09.909255 (+ 11244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.910107 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.911900 (+ 1793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.912235 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.912308 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:09.921616 (+ 9308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:09.921621 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:09.921623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:09.921653 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:09.923363 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.923973 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.923976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.923978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.924075 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.924457 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.924460 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.924462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.924708 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:09.924781 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:09.925492 (+ 711us) server_negotiation.cc:299] Negotiation successful
0811 04:50:09.925655 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:50:09.927830 31185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:09.891928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41981 (local address 127.17.188.67:34733)
0811 04:50:09.894191 (+ 2263us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:09.894253 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:09.896007 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:09.907511 (+ 11504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:09.907522 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:09.908166 (+ 644us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:09.909071 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:09.909095 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.910293 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.910296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:09.911754 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:09.911766 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.912522 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.912526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:09.912797 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:09.918971 (+ 6174us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:09.918993 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:09.921384 (+ 2391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:09.923494 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:09.923500 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:09.923518 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:09.923855 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.924178 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:09.924180 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:09.924183 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:09.924355 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:09.924859 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:09.924865 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:09.925198 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 04:50:09.926300 (+ 1102us) client_negotiation.cc:240] Negotiation successful
0811 04:50:09.926661 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1970,"thread_start_us":320,"threads_started":1}
Aug 11 04:50:09 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:09.930536 31183 heartbeater.cc:347] Connected to a master server at 127.17.188.126:41981
I20260811 04:50:09.931100 31183 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:09.931773 31183 heartbeater.cc:511] Master 127.17.188.126:41981 requested a full tablet report, sending...
I20260811 04:50:09.932863 30637 ts_manager.cc:194] Registered new tserver with Master: 8329d9600b084265bd116d51014690d3 (127.17.188.67:42435)
I20260811 04:50:09.933691 30637 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:34733
I20260811 04:50:09.942775 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:50:09.960687 30885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:09.945612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.17.188.126:41981)
0811 04:50:09.945739 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:09.945743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:09.949298 (+ 3555us) server_negotiation.cc:407] Connection header received
0811 04:50:09.949526 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:09.949530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:09.949613 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:09.949672 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:09.951763 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.952336 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.954481 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:09.954883 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:09.954966 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:09.957201 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:09.957205 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:09.957207 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:09.957235 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:09.958889 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.959370 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.959374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.959376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.959454 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:09.959741 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:09.959744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:09.959746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:09.959944 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:09.960053 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:09.960406 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 04:50:09.960532 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:50:09.966012 30637 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52152:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:50:09.974169 30637 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:50:10.016155 30880 heartbeater.cc:503] Master 127.17.188.126:41981 was elected leader, sending a full tablet report...
I20260811 04:50:10.036983 31201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.017565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:40359 (local address 127.0.0.1:49842)
0811 04:50:10.027882 (+ 10317us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:10.027896 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:10.028191 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:10.028883 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:10.028886 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:10.028902 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:10.028988 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.028994 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.033311 (+ 4317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.033314 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.034802 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.034813 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.036373 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.036376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.036485 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.036525 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 04:50:10.036687 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 04:50:10.036825 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10220,"thread_start_us":148,"threads_started":1}
I20260811 04:50:10.038266 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.017761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49842 (local address 127.17.188.66:40359)
0811 04:50:10.026417 (+ 8656us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.026425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.028292 (+ 1867us) server_negotiation.cc:407] Connection header received
0811 04:50:10.028376 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.028382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.028600 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.028739 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:10.029113 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.030273 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.034959 (+ 4686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.035934 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.036045 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.036194 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.037960 (+ 1766us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.038060 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8529,"thread_start_us":184,"threads_started":1}
I20260811 04:50:10.037860 31196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.015273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42435 (local address 127.0.0.1:48188)
0811 04:50:10.025782 (+ 10509us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:10.025866 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:10.026044 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:10.027397 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:10.027403 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:10.027440 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:10.027604 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.027612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.031735 (+ 4123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.031742 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.033176 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.033188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.037440 (+ 4252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.037444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.037530 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.037553 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:50:10.037643 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 04:50:10.037720 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10447,"spinlock_wait_cycles":4608,"thread_start_us":172,"threads_started":1}
I20260811 04:50:10.039795 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.016727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48188 (local address 127.17.188.67:42435)
0811 04:50:10.026446 (+ 9719us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.026490 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.026517 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:50:10.026604 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.026609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.026851 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.027213 (+ 362us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:10.030187 (+ 2974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.031610 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.035730 (+ 4120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.036700 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.036795 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.036924 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.039494 (+ 2570us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.039601 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9623,"thread_start_us":228,"threads_started":1}
I20260811 04:50:10.042822 31095 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 (DEFAULT_TABLE table=test-table [id=f874080226534e7ead6341c98703a0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:10.042822 30961 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 (DEFAULT_TABLE table=test-table [id=f874080226534e7ead6341c98703a0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:10.044123 30961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:10.044124 31095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:10.055215 31197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.015203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:39663 (local address 127.0.0.1:41890)
0811 04:50:10.025782 (+ 10579us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:10.025865 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:10.026044 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:10.027397 (+ 1353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:10.027403 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:10.027442 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:10.030041 (+ 2599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.030047 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.036980 (+ 6933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.036983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.038078 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.038087 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.053778 (+ 15691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.053782 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.053906 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.053936 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 04:50:10.054936 (+ 1000us) client_negotiation.cc:240] Negotiation successful
0811 04:50:10.055038 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10285,"mutex_wait_us":2499,"spinlock_wait_cycles":6016,"thread_start_us":290,"threads_started":1}
I20260811 04:50:10.055986 31198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.015392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41890 (local address 127.17.188.65:39663)
0811 04:50:10.026624 (+ 11232us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.026630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.026649 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:50:10.026710 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.026714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.026854 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.027212 (+ 358us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:10.030491 (+ 3279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.036226 (+ 5735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.038232 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.039248 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.055509 (+ 16261us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.055686 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.055744 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.055847 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11106,"thread_start_us":147,"threads_started":1}
I20260811 04:50:10.059437 30799 tablet_service.cc:1467] Processing CreateTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 (DEFAULT_TABLE table=test-table [id=f874080226534e7ead6341c98703a0d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:10.060678 30799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:10.064787 31204 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Bootstrap starting.
I20260811 04:50:10.070663 31204 tablet_bootstrap.cc:654] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:10.072150 31204 log.cc:824] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:10.074792 31204 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: No bootstrap required, opened a new log
I20260811 04:50:10.075014 31204 ts_tablet_manager.cc:1397] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 04:50:10.085033 31205 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Bootstrap starting.
I20260811 04:50:10.091688 31204 raft_consensus.cc:348] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.092289 31204 raft_consensus.cc:374] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:10.092386 31204 raft_consensus.cc:729] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2aeb2f5b3b774201a6b183362f250366, State: Initialized, Role: FOLLOWER
I20260811 04:50:10.092597 31205 tablet_bootstrap.cc:654] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:10.094132 31205 log.cc:824] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:10.094465 31204 consensus_queue.cc:260] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.096098 31204 ts_tablet_manager.cc:1428] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Time spent starting tablet: real 0.021s user 0.006s sys 0.004s
I20260811 04:50:10.096506 31035 heartbeater.cc:503] Master 127.17.188.126:41981 was elected leader, sending a full tablet report...
I20260811 04:50:10.097631 31206 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Bootstrap starting.
I20260811 04:50:10.114095 31205 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: No bootstrap required, opened a new log
I20260811 04:50:10.114343 31205 ts_tablet_manager.cc:1397] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Time spent bootstrapping tablet: real 0.030s user 0.006s sys 0.003s
I20260811 04:50:10.115931 31206 tablet_bootstrap.cc:654] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:10.120438 31206 log.cc:824] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:10.125371 31205 raft_consensus.cc:348] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.125723 31205 raft_consensus.cc:374] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:10.125783 31205 raft_consensus.cc:729] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8329d9600b084265bd116d51014690d3, State: Initialized, Role: FOLLOWER
I20260811 04:50:10.133240 31205 consensus_queue.cc:260] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.135363 31205 ts_tablet_manager.cc:1428] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Time spent starting tablet: real 0.021s user 0.007s sys 0.001s
I20260811 04:50:10.140821 31206 tablet_bootstrap.cc:492] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: No bootstrap required, opened a new log
I20260811 04:50:10.141075 31206 ts_tablet_manager.cc:1397] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.008s
W20260811 04:50:10.143973 31184 tablet.cc:2369] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:50:10.147818 31206 raft_consensus.cc:348] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.148123 31206 raft_consensus.cc:374] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:10.148177 31206 raft_consensus.cc:729] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e32f1fb62b74606a1e4fdaef58ff349, State: Initialized, Role: FOLLOWER
I20260811 04:50:10.148603 31183 heartbeater.cc:503] Master 127.17.188.126:41981 was elected leader, sending a full tablet report...
I20260811 04:50:10.151686 31206 consensus_queue.cc:260] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.152941 31206 ts_tablet_manager.cc:1428] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
W20260811 04:50:10.189270 31036 tablet.cc:2369] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:50:10.222826 30881 tablet.cc:2369] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:50:10.377483 31212 raft_consensus.cc:482] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:50:10.377897 31212 raft_consensus.cc:504] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.379561 31212 leader_election.cc:288] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8329d9600b084265bd116d51014690d3 (127.17.188.67:42435), 2aeb2f5b3b774201a6b183362f250366 (127.17.188.66:40359)
I20260811 04:50:10.387179 31203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.381346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:57255 (local address 127.17.188.66:40359)
0811 04:50:10.381517 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.381521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.382198 (+ 677us) server_negotiation.cc:407] Connection header received
0811 04:50:10.382400 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.382404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.382457 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.382507 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:10.383213 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.383951 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.385437 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.386340 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.386492 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.386579 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.386921 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.386996 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 04:50:10.387324 31214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.380496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:40359 (local address 127.17.188.65:57255)
0811 04:50:10.382103 (+ 1607us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:10.382120 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:10.382275 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:10.382650 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:10.382653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:10.382674 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:10.383048 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.383057 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.384123 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.384126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.385294 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.385311 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.386596 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.386603 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.386770 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.386816 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 04:50:10.386903 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 04:50:10.386980 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1525,"thread_start_us":224,"threads_started":1}
I20260811 04:50:10.388242 30983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed70c1b2c8d4f6bb9c9fe05820dec19" candidate_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aeb2f5b3b774201a6b183362f250366" is_pre_election: true
I20260811 04:50:10.388594 30983 raft_consensus.cc:2454] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e32f1fb62b74606a1e4fdaef58ff349 in term 0.
I20260811 04:50:10.389304 30755 leader_election.cc:302] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aeb2f5b3b774201a6b183362f250366, 6e32f1fb62b74606a1e4fdaef58ff349; no voters:
I20260811 04:50:10.389776 31212 raft_consensus.cc:2781] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:50:10.389878 31212 raft_consensus.cc:482] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:50:10.389943 31212 raft_consensus.cc:3037] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:10.391991 31212 raft_consensus.cc:504] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.392359 31212 leader_election.cc:288] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [CANDIDATE]: Term 1 election: Requested vote from peers 8329d9600b084265bd116d51014690d3 (127.17.188.67:42435), 2aeb2f5b3b774201a6b183362f250366 (127.17.188.66:40359)
I20260811 04:50:10.392756 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.381122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:49471 (local address 127.17.188.67:42435)
0811 04:50:10.381510 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.381515 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.381531 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:50:10.381609 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.381612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.381665 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.381747 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:10.386356 (+ 4609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.387048 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.391267 (+ 4219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.391890 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.391995 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.392046 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.392505 (+ 459us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.392605 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298}
I20260811 04:50:10.393061 30983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed70c1b2c8d4f6bb9c9fe05820dec19" candidate_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2aeb2f5b3b774201a6b183362f250366"
I20260811 04:50:10.393201 30983 raft_consensus.cc:3037] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:10.393523 31213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.379973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:42435 (local address 127.17.188.65:49471)
0811 04:50:10.380926 (+ 953us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:10.380944 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:10.381066 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:10.385875 (+ 4809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:10.385879 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:10.385900 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:10.386189 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.386198 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.387633 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.387637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.391053 (+ 3416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:10.391085 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.392198 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.392201 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:10.392307 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.392333 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:50:10.393127 (+ 794us) client_negotiation.cc:240] Negotiation successful
0811 04:50:10.393265 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":172,"threads_started":1}
I20260811 04:50:10.394701 31133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed70c1b2c8d4f6bb9c9fe05820dec19" candidate_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8329d9600b084265bd116d51014690d3"
I20260811 04:50:10.394596 31134 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9ed70c1b2c8d4f6bb9c9fe05820dec19" candidate_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8329d9600b084265bd116d51014690d3" is_pre_election: true
I20260811 04:50:10.395066 30983 raft_consensus.cc:2454] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e32f1fb62b74606a1e4fdaef58ff349 in term 1.
I20260811 04:50:10.395016 31133 raft_consensus.cc:3037] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:10.395381 30755 leader_election.cc:302] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2aeb2f5b3b774201a6b183362f250366, 6e32f1fb62b74606a1e4fdaef58ff349; no voters:
I20260811 04:50:10.395565 31212 raft_consensus.cc:2781] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:50:10.395844 31212 raft_consensus.cc:686] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [term 1 LEADER]: Becoming Leader. State: Replica: 6e32f1fb62b74606a1e4fdaef58ff349, State: Running, Role: LEADER
I20260811 04:50:10.396185 31212 consensus_queue.cc:237] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } }
I20260811 04:50:10.397228 31133 raft_consensus.cc:2454] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e32f1fb62b74606a1e4fdaef58ff349 in term 1.
I20260811 04:50:10.399950 30637 catalog_manager.cc:5495] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e32f1fb62b74606a1e4fdaef58ff349 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e32f1fb62b74606a1e4fdaef58ff349" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 39663 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 } health_report { overall_health: UNKNOWN } } }
Aug 11 04:50:10 dist-test-slave-njxd krb5kdc[30089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423809, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:10.480772 31198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:10.475433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41902 (local address 127.17.188.65:39663)
0811 04:50:10.475563 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:10.475568 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:10.475599 (+ 31us) server_negotiation.cc:407] Connection header received
0811 04:50:10.475695 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:10.475699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:10.475767 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:10.475887 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:50:10.476224 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.477059 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.478478 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:10.478831 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:10.478919 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:10.479434 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:50:10.480066 (+ 632us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:50:10.480172 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:10.480366 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 04:50:10.480462 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:50:10.493263 30983 raft_consensus.cc:1261] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 1 FOLLOWER]: Refusing update from remote peer 6e32f1fb62b74606a1e4fdaef58ff349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:50:10.493355 31133 raft_consensus.cc:1261] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 1 FOLLOWER]: Refusing update from remote peer 6e32f1fb62b74606a1e4fdaef58ff349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:50:10.494159 31216 consensus_queue.cc:1035] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8329d9600b084265bd116d51014690d3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 42435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:50:10.494658 31216 consensus_queue.cc:1035] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 6e32f1fb62b74606a1e4fdaef58ff349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2aeb2f5b3b774201a6b183362f250366" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:50:10.523396 31221 mvcc.cc:205] Tried to move back new op lower bound from 7317191927770411008 to 7317191927387287552. Current Snapshot: MvccSnapshot[applied={T|T < 7317191927770411008}]
I20260811 04:50:10.527308 31226 mvcc.cc:205] Tried to move back new op lower bound from 7317191927770411008 to 7317191927387287552. Current Snapshot: MvccSnapshot[applied={T|T < 7317191927770411008}]
I20260811 04:50:10.540126 30637 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:50:10.540336 30637 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52152:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:50:10.543015 30637 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b9be4f42c89e416a8266b59d585b8983: Sending DeleteTablet for 3 replicas of tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19
I20260811 04:50:10.543784 30799 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:10 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:41890
I20260811 04:50:10.544847 31095 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:10 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:48188
I20260811 04:50:10.545528 30961 tablet_service.cc:1514] Processing DeleteTablet for tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:10 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49842
I20260811 04:50:10.547273 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 30731
I20260811 04:50:10.554278 31237 tablet_replica.cc:330] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: stopping tablet replica
I20260811 04:50:10.554739 31237 raft_consensus.cc:2229] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:50:10.555217 31237 raft_consensus.cc:2258] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:50:10.555779 31235 tablet_replica.cc:330] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: stopping tablet replica
I20260811 04:50:10.556139 31235 raft_consensus.cc:2229] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:50:10.556435 31235 raft_consensus.cc:2258] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:50:10.558535 31235 ts_tablet_manager.cc:1905] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:50:10.562201 31235 ts_tablet_manager.cc:1918] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:50:10.562316 31235 log.cc:1196] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9ed70c1b2c8d4f6bb9c9fe05820dec19
I20260811 04:50:10.562670 31235 ts_tablet_manager.cc:1939] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 8329d9600b084265bd116d51014690d3: Deleting consensus metadata
I20260811 04:50:10.564121 30621 catalog_manager.cc:4841] TS 8329d9600b084265bd116d51014690d3 (127.17.188.67:42435): tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 (table test-table [id=f874080226534e7ead6341c98703a0d6]) successfully deleted
I20260811 04:50:10.568405 31237 ts_tablet_manager.cc:1905] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:50:10.584386 31237 ts_tablet_manager.cc:1918] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:50:10.584645 31237 log.cc:1196] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9ed70c1b2c8d4f6bb9c9fe05820dec19
I20260811 04:50:10.585083 31237 ts_tablet_manager.cc:1939] T 9ed70c1b2c8d4f6bb9c9fe05820dec19 P 2aeb2f5b3b774201a6b183362f250366: Deleting consensus metadata
I20260811 04:50:10.586702 30621 catalog_manager.cc:4841] TS 2aeb2f5b3b774201a6b183362f250366 (127.17.188.66:40359): tablet 9ed70c1b2c8d4f6bb9c9fe05820dec19 (table test-table [id=f874080226534e7ead6341c98703a0d6]) successfully deleted
W20260811 04:50:10.587404 30622 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:39663 (error 108)
I20260811 04:50:10.588373 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 30889
I20260811 04:50:10.598559 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 31041
I20260811 04:50:10.627122 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 30598
I20260811 04:50:10.639256 18161 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 04:50:10.983434 18161 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 04:50:10.983646 18161 mini_ranger.cc:66] Stopping Ranger...
I20260811 04:50:11.327615 18161 mini_ranger.cc:68] Stopped Ranger
2026-08-11 04:50:11.327 UTC [30122] LOG: received smart shutdown request
2026-08-11 04:50:11.331 UTC [30122] LOG: background worker "logical replication launcher" (PID 30131) exited with exit code 1
2026-08-11 04:50:11.332 UTC [30126] LOG: shutting down
2026-08-11 04:50:11.474 UTC [30122] LOG: database system is shut down
2026-08-11T04:50:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (52906 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:50:11 dist-test-slave-njxd krb5kdc[31249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:50:11 dist-test-slave-njxd krb5kdc[31249](info): set up 2 sockets
Aug 11 04:50:11 dist-test-slave-njxd krb5kdc[31249](info): commencing operation
krb5kdc: starting...
W20260811 04:50:12.704631 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:50:12 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:50:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:50:12Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangeradmin_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangeradmin_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangerlookup_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangerlookup_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
I20260811 04:50:12.876609 18161 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task9CJn4q/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/postgres -l logfile start
2026-08-11 04:50:15.265 UTC [31280] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 04:50:15.265 UTC [31280] LOG: listening on IPv4 address "127.17.188.84", port 38433
2026-08-11 04:50:15.268 UTC [31280] LOG: listening on Unix socket "/tmp/.s.PGSQL.38433"
2026-08-11 04:50:15.290 UTC [31283] LOG: database system was shut down at 2026-08-11 04:50:13 UTC
2026-08-11 04:50:15.294 UTC [31280] LOG: database system is ready to accept connections
I20260811 04:50:16.302512 18161 mini_postgres.cc:96] Postgres bound to 38433
2026-08-11 04:50:16.310 UTC [31293] FATAL: database "slave" does not exist
127.17.188.84:38433 - accepting connections
I20260811 04:50:16.310736 18161 mini_ranger.cc:161] Starting Ranger...
I20260811 04:50:16.326087 18161 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 04:50:16.790395 18161 mini_ranger.cc:87] Created ranger Postgres database
I20260811 04:50:16.790468 18161 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin
2026-08-11 04:50:17,070 [I] DB FLAVOR :POSTGRES
2026-08-11 04:50:17,071 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 04:50:17,071 [I] Checking connection..
2026-08-11 04:50:17,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 04:50:17,311 [I] Checking connection passed.
2026-08-11 04:50:17,311 [I] --------- Verifying version history table ---------
2026-08-11 04:50:17,311 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:50:17,566 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 04:50:17,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:50:17,820 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 04:50:17,821 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 04:50:17,821 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 04:50:18.084 UTC [31368] WARNING: there is no transaction in progress
2026-08-11 04:50:18,090 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 04:50:18,091 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 04:50:18,352 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 04:50:18,352 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 04:50:18,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 04:50:18,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 04:50:18,833 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-njxd.c.gcp-upstream.internal','N') ;"
2026-08-11 04:50:19,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 04:50:19,345 [I] Table x_portal_user does not exist in database ranger
2026-08-11 04:50:19,345 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 04:50:19,612 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 04:50:19,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 04:50:19,876 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 04:50:20,139 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 04:50:20,139 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 04:50:21.081 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.097 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.113 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.128 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.144 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.161 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.214 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.220 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.233 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.243 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.253 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.267 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.277 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.283 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.289 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21.296 UTC [31489] WARNING: there is no transaction in progress
2026-08-11 04:50:21,899 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 04:50:21,899 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 04:50:22,146 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 04:50:22,146 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 04:50:22,398 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 04:50:22,398 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 04:50:22,662 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 04:50:22,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 04:50:22,893 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 04:50:23,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-njxd.c.gcp-upstream.internal';"
2026-08-11 04:50:23,404 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 04:50:23,404 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 04:50:23,669 [I] DB_PATCHES have already been applied
I20260811 04:50:23.674971 18161 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task9CJn4q/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 04:50:23.675045 18161 mini_ranger.cc:193] Using host: 127.17.188.84
I20260811 04:50:23.679513 18161 mini_ranger.cc:227] Ranger admin URL: http://127.17.188.84:36009
Aug 11, 2026 4:50:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:50:23 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:50:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 4:50:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 4:50:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 4:50:24 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 4:50:24 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 04:50:24.865592 18161 mini_ranger.cc:160] Time spent starting Ranger: real 8.555s user 0.000s sys 0.011s
Aug 11, 2026 4:50:44 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 4:50:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 4:50:44 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 4:50:44 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 4:50:45 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 04:50:45.929976 18161 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.17.188.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.17.188.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangerkms_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.17.188.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/rangerkms_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.17.188.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.17.188.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.17.188.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/HTTP_127.17.188.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 04:50:46 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423846, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 04:50:46.019666 18161 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 04:50:46.030079 18161 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 04:50:46.892467 18161 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 04:50:46.892544 18161 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms
I20260811 04:50:46.892557 18161 mini_ranger_kms.cc:227] Using postgres at 127.17.188.84:38433
2026-08-11 04:50:47,085 [I] DB FLAVOR :POSTGRES
2026-08-11 04:50:47,085 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 04:50:47,085 [I] Checking connection
2026-08-11 04:50:47,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 04:50:47,327 [I] connection success
2026-08-11 04:50:47,327 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 04:50:47,328 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 04:50:47,328 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 04:50:47,595 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 04:50:47,595 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 04:50:47,595 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 04:50:47,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.17.188.84:38433/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 04:50:47,864 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 04:50:48.321004 18161 mini_ranger_kms.cc:310] Created kms service
I20260811 04:50:48.532616 18161 mini_ranger_kms.cc:326] Created kudu user
I20260811 04:50:48.577188 18161 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 04:50:48 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423846, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:48.951951 18161 mini_ranger_kms.cc:384] Added ranger policy
I20260811 04:50:48.952136 18161 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms:/tmp/dist-test-task9CJn4q/build/debug/bin/postgresql.jar:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task9CJn4q/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 04:50:48.952167 18161 mini_ranger_kms.cc:240] Using host: 127.17.188.84
I20260811 04:50:48.956836 18161 mini_ranger_kms.cc:276] Ranger KMS PID: 31689
I20260811 04:50:48.956938 18161 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.17.188.84:38155
Aug 11, 2026 4:50:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 4:50:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 4:50:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 4:50:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 4:50:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 4:50:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 04:50:51 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786423851, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:51.291107 18161 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.271s user 0.000s sys 0.174s
I20260811 04:50:51.291244 18161 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 04:50:51.291311 18161 mini_ranger_kms.cc:401] 127.17.188.84:38155/kms/v1/keys
Aug 11 04:50:51 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423851, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
Aug 11 04:50:52 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423851, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.17.188.84@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
Aug 11 04:50:54 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:50:54.352432 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34603
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34603
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:54.466744 31744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:54.467005 31744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:54.467046 31744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:54.471138 31744 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:50:54.471202 31744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:54.471222 31744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:54.471238 31744 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:50:54.471254 31744 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:50:54.477051 31744 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
--ranger_kms_url=127.17.188.84:38155/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34603
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:54.478272 31744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:54.479347 31744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:54.488517 31749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:54.488516 31750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:54.488795 31744 server_base.cc:1034] running on GCE node
W20260811 04:50:54.488885 31752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:54.489622 31744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:54.491119 31744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:54.492334 31744 hybrid_clock.cc:648] HybridClock initialized: now 1786423854492308 us; error 35 us; skew 500 ppm
Aug 11 04:50:54 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423854, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:54.500658 31744 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:50:54.501668 31744 webserver.cc:460] Webserver started at http://127.17.188.126:35323/ using document root <none> and password file <none>
I20260811 04:50:54.502235 31744 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:54.502317 31744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:54.502549 31744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:54 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423854, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:54.565304 31744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "9ab6b5450b1e4eaa879320d2f28015c0"
format_stamp: "Formatted at 2026-08-11 04:50:54 on dist-test-slave-njxd"
server_key: "f3086cf9b6b2dea2e42ecbe30c73914b"
server_key_iv: "c802d4f268e10f281c7520faff4a17c2"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:54.565992 31744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "9ab6b5450b1e4eaa879320d2f28015c0"
format_stamp: "Formatted at 2026-08-11 04:50:54 on dist-test-slave-njxd"
server_key: "f3086cf9b6b2dea2e42ecbe30c73914b"
server_key_iv: "c802d4f268e10f281c7520faff4a17c2"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:54.570011 31744 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 04:50:54.584062 31759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:54.585548 31744 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:50:54.585767 31744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "9ab6b5450b1e4eaa879320d2f28015c0"
format_stamp: "Formatted at 2026-08-11 04:50:54 on dist-test-slave-njxd"
server_key: "f3086cf9b6b2dea2e42ecbe30c73914b"
server_key_iv: "c802d4f268e10f281c7520faff4a17c2"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:54.585914 31744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:54.600404 31744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:54.603437 31744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:54.603652 31744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:54.612046 31744 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34603
I20260811 04:50:54.612051 31817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34603 every 8 connection(s)
I20260811 04:50:54.613148 31744 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:50:54.616082 31818 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:54.620369 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 31744
I20260811 04:50:54.620505 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:50:54.620786 18161 external_mini_cluster.cc:1428] Setting key d92246d39c98f488ce04e1c92659bb61
I20260811 04:50:54.622282 31818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Bootstrap starting.
I20260811 04:50:54.625142 31818 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:54.626081 31818 log.cc:824] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:54.628062 31818 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: No bootstrap required, opened a new log
Aug 11 04:50:54 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423854, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:54.632350 31818 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:54.632668 31818 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:54.632778 31818 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab6b5450b1e4eaa879320d2f28015c0, State: Initialized, Role: FOLLOWER
I20260811 04:50:54.633355 31818 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:54.633530 31818 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:50:54.633630 31818 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:50:54.633795 31818 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:54.634946 31818 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:54.635396 31818 leader_election.cc:302] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab6b5450b1e4eaa879320d2f28015c0; no voters:
I20260811 04:50:54.635761 31818 leader_election.cc:288] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:50:54.635828 31825 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:50:54.636353 31825 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 LEADER]: Becoming Leader. State: Replica: 9ab6b5450b1e4eaa879320d2f28015c0, State: Running, Role: LEADER
I20260811 04:50:54.636678 31825 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:54.638024 31818 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:50:54.638231 31822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:54.622363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46626 (local address 127.17.188.126:34603)
0811 04:50:54.622843 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:54.622863 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:54.622904 (+ 41us) server_negotiation.cc:407] Connection header received
0811 04:50:54.623794 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:54.623844 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:54.624282 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:54.624715 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:54.625660 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:54.626988 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:54.628218 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:54.628923 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:54.629103 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:54.632299 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:54.632305 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:54.632321 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:54.632354 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:54.634531 (+ 2177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:54.635084 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:54.635090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:54.635096 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:54.635237 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:54.635567 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:54.635570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:54.635572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:54.636129 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:54.636336 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:54.636985 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 04:50:54.637267 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":165,"threads_started":1}
I20260811 04:50:54.638818 31825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } } }
I20260811 04:50:54.638928 31825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:54.639583 31828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab6b5450b1e4eaa879320d2f28015c0. Latest consensus state: current_term: 1 leader_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } } }
I20260811 04:50:54.639670 31828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:54.640363 31818 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 04:50:54.641458 31835 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:50:54.647838 31835 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:50:54.655774 31847 mvcc.cc:205] Tried to move back new op lower bound from 7317192108655288320 to 7317192108596215808. Current Snapshot: MvccSnapshot[applied={T|T < 7317192108655288320}]
I20260811 04:50:54.657975 31835 catalog_manager.cc:1347] Generated new cluster ID: d0fd545ba37246f6bcbea191a3f191ab
I20260811 04:50:54.658088 31835 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:50:54.679306 31835 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:50:54.680733 31835 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:50:54.691270 31835 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Generated new TSK 0
I20260811 04:50:54.692215 31835 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:50:55.457901 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:55.603789 31871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:55.604240 31871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:55.604382 31871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:55.610589 31871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:55.610677 31871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:55.610766 31871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:50:55.618319 31871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31871
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:55.619514 31871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:55.621008 31871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:55.633569 31879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:55.633662 31882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:55.633841 31880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:55.634295 31871 server_base.cc:1034] running on GCE node
I20260811 04:50:55.634873 31871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:55.635725 31871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:55.636943 31871 hybrid_clock.cc:648] HybridClock initialized: now 1786423855636899 us; error 51 us; skew 500 ppm
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:55.640918 31871 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:50:55.641937 31871 webserver.cc:460] Webserver started at http://127.17.188.65:34557/ using document root <none> and password file <none>
I20260811 04:50:55.642532 31871 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:55.642625 31871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:55.642886 31871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:55.663159 31871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "387d9e8786b643e2ba9d05872fa5d56a"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "7201c2df2fb94d71b75bb22099ded3f9"
server_key_iv: "765e147fe8e6744c3607f79d8caea915"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:55.664417 31871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "387d9e8786b643e2ba9d05872fa5d56a"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "7201c2df2fb94d71b75bb22099ded3f9"
server_key_iv: "765e147fe8e6744c3607f79d8caea915"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:55.681883 31871 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.005s sys 0.000s
I20260811 04:50:55.725993 31891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:55.727975 31871 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.000s
I20260811 04:50:55.728140 31871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "387d9e8786b643e2ba9d05872fa5d56a"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "7201c2df2fb94d71b75bb22099ded3f9"
server_key_iv: "765e147fe8e6744c3607f79d8caea915"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:55.728292 31871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:55.752574 31871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:55.756274 31871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:55.756460 31871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:55.757177 31871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:55.758200 31871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:55.758262 31871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:55.758313 31871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:55.758340 31871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:55.769454 31871 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:40639
I20260811 04:50:55.769472 32015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:40639 every 8 connection(s)
I20260811 04:50:55.771230 31871 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:50:55.777856 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 31871
I20260811 04:50:55.777995 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:50:55.778318 18161 external_mini_cluster.cc:1428] Setting key 582be8f50593675b9d71980ab3f4f9d3
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:55.787981 32019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:55.773843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.65:35535)
0811 04:50:55.774334 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:55.774387 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:55.775281 (+ 894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:55.775862 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:55.775869 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:55.776137 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:55.776652 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:55.776666 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:55.777493 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:55.777496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:55.778575 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:55.778585 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:55.779307 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:55.779311 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:55.779492 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:55.780215 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:55.780236 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:55.782082 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:55.784380 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:55.784389 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:55.784406 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:55.784770 (+ 364us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:55.785092 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:55.785097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:55.785102 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:55.785283 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:55.785873 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:55.785882 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:55.786231 (+ 349us) client_negotiation.cc:769] Sending connection context
0811 04:50:55.786451 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 04:50:55.786823 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":160,"threads_started":1}
I20260811 04:50:55.789047 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:55.773350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35535 (local address 127.17.188.126:34603)
0811 04:50:55.773631 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:55.773637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:55.774494 (+ 857us) server_negotiation.cc:407] Connection header received
0811 04:50:55.775494 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:55.775498 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:55.775560 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:55.775657 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:55.776804 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:55.777361 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:55.778698 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:55.779043 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:55.779136 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:55.782309 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:55.782314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:55.782321 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:55.782366 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:55.784252 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:55.784888 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:55.784894 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:55.784898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:55.784993 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:55.785395 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:55.785401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:55.785405 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:55.785698 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:55.785810 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:55.788702 (+ 2892us) server_negotiation.cc:299] Negotiation successful
0811 04:50:55.788842 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":82,"threads_started":1}
I20260811 04:50:55.790257 32016 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:55.790580 32016 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:55.791199 32016 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:55.792995 31777 ts_manager.cc:194] Registered new tserver with Master: 387d9e8786b643e2ba9d05872fa5d56a (127.17.188.65:40639)
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:50:55.794366 31777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:35535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:50:55.816145 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:55.943663 32023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:55.944001 32023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:55.944087 32023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:55.949199 32023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:55.949270 32023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:55.949363 32023 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:50:55.956398 32023 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32023
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:55.957526 32023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:55.958570 32023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:55.968436 32032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:55.968441 32031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:55.968941 32034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:55.969532 32023 server_base.cc:1034] running on GCE node
I20260811 04:50:55.969966 32023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:55.970636 32023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:55.971812 32023 hybrid_clock.cc:648] HybridClock initialized: now 1786423855971782 us; error 39 us; skew 500 ppm
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:55.974774 32023 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:50:55.975708 32023 webserver.cc:460] Webserver started at http://127.17.188.66:45357/ using document root <none> and password file <none>
I20260811 04:50:55.976359 32023 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:55.976446 32023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:55.976650 32023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:55 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:55.997455 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "8a7bd0fcbd46456994ca7d4530f27cef"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "fd385ee1b79f670396f56336040ae277"
server_key_iv: "4a869315d999c9497e9cb522c8e11ada"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:55.998288 32023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "8a7bd0fcbd46456994ca7d4530f27cef"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "fd385ee1b79f670396f56336040ae277"
server_key_iv: "4a869315d999c9497e9cb522c8e11ada"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.002619 32023 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:50:56.034664 32042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.036412 32023 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.000s
I20260811 04:50:56.036566 32023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "8a7bd0fcbd46456994ca7d4530f27cef"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "fd385ee1b79f670396f56336040ae277"
server_key_iv: "4a869315d999c9497e9cb522c8e11ada"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.036724 32023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:56.060526 32023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:56.064328 32023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:56.064539 32023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:56.065308 32023 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:56.066391 32023 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:56.066457 32023 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.066509 32023 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:56.066556 32023 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.086113 32023 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:40781
I20260811 04:50:56.087316 32023 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:50:56.089802 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32023
I20260811 04:50:56.089936 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:50:56.090294 18161 external_mini_cluster.cc:1428] Setting key d71274cb9db54d29bcdf491c2e20c85d
I20260811 04:50:56.088649 32161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:40781 every 8 connection(s)
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:56.107041 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:56.092418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:51731 (local address 127.17.188.126:34603)
0811 04:50:56.094373 (+ 1955us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:56.094379 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:56.094398 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:50:56.094820 (+ 422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:56.094824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:56.094875 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:56.094927 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:56.096600 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.097424 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.099075 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.099440 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.099522 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:56.102743 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:56.102748 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:56.102750 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:56.102777 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:56.104558 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:56.105183 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:56.105187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:56.105188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:56.105276 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:56.105734 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:56.105738 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:56.105740 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:56.105964 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:56.106053 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:56.106730 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 04:50:56.106869 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1864}
I20260811 04:50:56.109208 32166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:56.091149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.66:51731)
0811 04:50:56.093215 (+ 2066us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:56.093276 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:56.094464 (+ 1188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:56.095345 (+ 881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:56.095354 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:56.095725 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:56.096427 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:56.096446 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.097623 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.097626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:56.098940 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:56.098951 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.099718 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.099722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:56.099912 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:56.100630 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:56.100651 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:56.102547 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:56.104702 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:56.104707 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:56.104723 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:56.105051 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:56.105390 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:56.105393 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:56.105394 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:56.105616 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:56.106124 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:56.106130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:56.106445 (+ 315us) client_negotiation.cc:769] Sending connection context
0811 04:50:56.107515 (+ 1070us) client_negotiation.cc:240] Negotiation successful
0811 04:50:56.108050 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1780,"thread_start_us":138,"threads_started":1}
I20260811 04:50:56.113031 32164 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:56.113293 32164 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:56.113996 32164 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:56.115257 31777 ts_manager.cc:194] Registered new tserver with Master: 8a7bd0fcbd46456994ca7d4530f27cef (127.17.188.66:40781)
I20260811 04:50:56.116031 31777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:51731
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:50:56.161062 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423855, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
W20260811 04:50:56.349813 32169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:56.350175 32169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:56.350241 32169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:56.356204 32169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:56.356287 32169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:56.356371 32169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:50:56.363513 32169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:56.364862 32169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:56.366217 32169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:56.379127 32176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:56.379153 32177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:56.379987 32180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:56.380198 32169 server_base.cc:1034] running on GCE node
I20260811 04:50:56.380869 32169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:56.381635 32169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:56.382853 32169 hybrid_clock.cc:648] HybridClock initialized: now 1786423856382788 us; error 76 us; skew 500 ppm
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:56.386616 32169 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:50:56.387635 32169 webserver.cc:460] Webserver started at http://127.17.188.67:43945/ using document root <none> and password file <none>
I20260811 04:50:56.388290 32169 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:56.388370 32169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:50:56.388581 32169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:56.405779 32169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "f9e1016977f14fab80150ca3d0ebafd5"
format_stamp: "Formatted at 2026-08-11 04:50:56 on dist-test-slave-njxd"
server_key: "ce86a595cf91eaac9f8d84e7964dbfe8"
server_key_iv: "45db62d28a9a04b4b06c66fbd29e341a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.406527 32169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "f9e1016977f14fab80150ca3d0ebafd5"
format_stamp: "Formatted at 2026-08-11 04:50:56 on dist-test-slave-njxd"
server_key: "ce86a595cf91eaac9f8d84e7964dbfe8"
server_key_iv: "45db62d28a9a04b4b06c66fbd29e341a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.411866 32169 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 04:50:56.428315 32187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.430069 32169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:50:56.430212 32169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "f9e1016977f14fab80150ca3d0ebafd5"
format_stamp: "Formatted at 2026-08-11 04:50:56 on dist-test-slave-njxd"
server_key: "ce86a595cf91eaac9f8d84e7964dbfe8"
server_key_iv: "45db62d28a9a04b4b06c66fbd29e341a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.430342 32169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:56.448518 32169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:56.452440 32169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:56.452658 32169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:56.453409 32169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:56.454527 32169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:56.454617 32169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.454672 32169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:56.454701 32169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.467201 32169 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:40705
I20260811 04:50:56.467234 32308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:40705 every 8 connection(s)
I20260811 04:50:56.468538 32169 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:50:56.471428 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32169
I20260811 04:50:56.471549 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:50:56.471846 18161 external_mini_cluster.cc:1428] Setting key e4ac8fbfe5bbc086b5a7aecdbc6795c2
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:56.485508 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:56.470704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:53943 (local address 127.17.188.126:34603)
0811 04:50:56.470881 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:56.470887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:56.472399 (+ 1512us) server_negotiation.cc:407] Connection header received
0811 04:50:56.473636 (+ 1237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:56.473640 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:56.473695 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:56.473749 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:56.475392 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.476192 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.477917 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.478254 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.478331 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:56.481454 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:56.481458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:56.481461 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:56.481489 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:56.483202 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:56.483800 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:56.483803 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:56.483805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:56.483886 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:56.484247 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:56.484250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:56.484252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:56.484453 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:56.484537 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:56.485227 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 04:50:56.485347 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 04:50:56.487754 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:56.471188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.67:53943)
0811 04:50:56.472230 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:56.472288 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:56.473354 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:56.474168 (+ 814us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:56.474178 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:56.474536 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:56.475219 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:56.475238 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.476357 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.476360 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:56.477772 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:56.477785 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:56.478530 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:56.478533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:56.478739 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:56.479454 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:56.479474 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:56.481269 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:56.483335 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:56.483341 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:56.483356 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:56.483687 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:56.483984 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:56.483987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:56.483988 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:56.484148 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:56.484648 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:56.484654 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:56.484950 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 04:50:56.485918 (+ 968us) client_negotiation.cc:240] Negotiation successful
0811 04:50:56.486262 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":187,"threads_started":1}
I20260811 04:50:56.489249 32309 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:56.489531 32309 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:56.490201 32309 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:56.491593 31777 ts_manager.cc:194] Registered new tserver with Master: f9e1016977f14fab80150ca3d0ebafd5 (127.17.188.67:40705)
I20260811 04:50:56.492323 31777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:53943
I20260811 04:50:56.493961 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:50:56.494840 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 31871
I20260811 04:50:56.506265 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32023
I20260811 04:50:56.515123 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32169
I20260811 04:50:56.528486 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 31744
I20260811 04:50:56.538506 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34603
--webserver_interface=127.17.188.126
--webserver_port=35323
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34603
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:50:56.652102 32313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:56.652388 32313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:56.652429 32313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:56.656587 32313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:50:56.656661 32313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:56.656682 32313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:56.656697 32313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:50:56.656713 32313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:50:56.662258 32313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34603
--ranger_config_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=35323
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:56.663450 32313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:56.664444 32313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:56.673310 32319 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:56.673357 32313 server_base.cc:1034] running on GCE node
W20260811 04:50:56.673388 32320 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:56.673310 32322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:56.674048 32313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:56.675256 32313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:56.676445 32313 hybrid_clock.cc:648] HybridClock initialized: now 1786423856676435 us; error 29 us; skew 500 ppm
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:56.679190 32313 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:50:56.680081 32313 webserver.cc:460] Webserver started at http://127.17.188.126:35323/ using document root <none> and password file <none>
I20260811 04:50:56.680667 32313 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:56.680763 32313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:56.762858 32313 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:50:56.765396 32331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:56.766954 32313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:50:56.767105 32313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "9ab6b5450b1e4eaa879320d2f28015c0"
format_stamp: "Formatted at 2026-08-11 04:50:54 on dist-test-slave-njxd"
server_key: "f3086cf9b6b2dea2e42ecbe30c73914b"
server_key_iv: "c802d4f268e10f281c7520faff4a17c2"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:56.767678 32313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:56.788409 32313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:56.791050 32313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:56.791267 32313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:56.798935 32313 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34603
I20260811 04:50:56.798974 32389 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34603 every 8 connection(s)
I20260811 04:50:56.800016 32313 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:50:56.804266 32390 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:50:56.805907 32390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Bootstrap starting.
I20260811 04:50:56.807031 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32313
I20260811 04:50:56.807518 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:40639
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:34603
--webserver_port=34557
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:50:56.823706 32390 log.cc:824] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:56.830518 32390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:50:56.830960 32390 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Bootstrap complete.
I20260811 04:50:56.835321 32390 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:56.835747 32390 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ab6b5450b1e4eaa879320d2f28015c0, State: Initialized, Role: FOLLOWER
I20260811 04:50:56.836282 32390 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:56.836429 32390 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:50:56.836519 32390 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:50:56.836647 32390 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:50:56.838593 32390 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:56.838930 32390 leader_election.cc:302] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ab6b5450b1e4eaa879320d2f28015c0; no voters:
I20260811 04:50:56.839265 32390 leader_election.cc:288] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 04:50:56.839349 32394 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 04:50:56.839586 32394 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [term 2 LEADER]: Becoming Leader. State: Replica: 9ab6b5450b1e4eaa879320d2f28015c0, State: Running, Role: LEADER
I20260811 04:50:56.839877 32394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } }
I20260811 04:50:56.840554 32390 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:50:56.841192 32395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ab6b5450b1e4eaa879320d2f28015c0. Latest consensus state: current_term: 2 leader_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } } }
I20260811 04:50:56.841339 32395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:56.842114 32396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ab6b5450b1e4eaa879320d2f28015c0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34603 } } }
I20260811 04:50:56.842259 32403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:50:56.842285 32396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:50:56.845482 32403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:50:56.846037 32390 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 04:50:56.846187 32403 catalog_manager.cc:1259] Loaded cluster ID: d0fd545ba37246f6bcbea191a3f191ab
I20260811 04:50:56.846237 32403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:50:56.851630 32403 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:50:56.852965 32403 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Loaded TSK: 0
I20260811 04:50:56.854178 32403 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:50:56.933508 32392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:56.933864 32392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:56.933941 32392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:56.938226 32392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:56.938293 32392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:56.938376 32392 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:50:56.945226 32392 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:40639
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=34557
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:56.946447 32392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:56.947515 32392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:56.958771 32431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:56.958783 32434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:56.960081 32392 server_base.cc:1034] running on GCE node
W20260811 04:50:56.961743 32432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:56.962296 32392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:56.963126 32392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:56.970541 32392 hybrid_clock.cc:648] HybridClock initialized: now 1786423856970507 us; error 45 us; skew 500 ppm
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:56.974371 32392 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:50:56.975577 32392 webserver.cc:460] Webserver started at http://127.17.188.65:34557/ using document root <none> and password file <none>
I20260811 04:50:56.976306 32392 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:56.976409 32392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 04:50:56 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:56.999506 32392 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:50:57.002983 32442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.004685 32392 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:50:57.004889 32392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "387d9e8786b643e2ba9d05872fa5d56a"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "7201c2df2fb94d71b75bb22099ded3f9"
server_key_iv: "765e147fe8e6744c3607f79d8caea915"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:57.005765 32392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:57.028221 32392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:57.031903 32392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:57.032181 32392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:57.032996 32392 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:57.034180 32392 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:57.034289 32392 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.034422 32392 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:57.034518 32392 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.046010 32392 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:40639
I20260811 04:50:57.047297 32392 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:50:57.048209 32563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:40639 every 8 connection(s)
I20260811 04:50:57.048558 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32392
I20260811 04:50:57.049074 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:40781
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:34603
--webserver_port=45357
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423856, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:57.073680 32567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.054132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.65:58729)
0811 04:50:57.054750 (+ 618us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:57.054811 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:57.055885 (+ 1074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:57.059290 (+ 3405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:57.059301 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:57.059590 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:57.060167 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.060189 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.062205 (+ 2016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.062209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.063365 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.063376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.064434 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.064439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.064652 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.065344 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:57.065366 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:57.067283 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:57.069847 (+ 2564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.069853 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.069867 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.070209 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.070707 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.070712 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.070715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.070898 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.071672 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:57.071678 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:57.072094 (+ 416us) client_negotiation.cc:769] Sending connection context
0811 04:50:57.072299 (+ 205us) client_negotiation.cc:240] Negotiation successful
0811 04:50:57.072644 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":144,"threads_started":1}
I20260811 04:50:57.075749 32568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.057201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:58729 (local address 127.17.188.126:34603)
0811 04:50:57.057964 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:57.057987 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:57.058031 (+ 44us) server_negotiation.cc:407] Connection header received
0811 04:50:57.058320 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:57.058334 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:57.058776 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:57.060416 (+ 1640us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:57.060745 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.062045 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.063520 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.064237 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.065059 (+ 822us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.067499 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:57.067506 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:57.067521 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:57.067551 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:57.069707 (+ 2156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.070372 (+ 665us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.070377 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.070384 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.070523 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.071027 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.071032 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.071035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.071517 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:57.074411 (+ 2894us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:57.074602 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 04:50:57.074890 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":112,"threads_started":1}
I20260811 04:50:57.079005 32564 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:57.079283 32564 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.079869 32564 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.084858 32564 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:34603 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 04:50:57.084998 32564 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.085208 32564 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:57.086297 32564 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.086496 32564 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.087299 32564 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 04:50:57.212638 32566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:57.213032 32566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:57.213109 32566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:57.218510 32566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:57.218577 32566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:57.218638 32566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:50:57.225703 32566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:40781
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=45357
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:57.226881 32566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:57.228109 32566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:50:57.240073 32574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:57.240073 32577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:57.240212 32575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:57.240665 32566 server_base.cc:1034] running on GCE node
I20260811 04:50:57.241129 32566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:57.242025 32566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:57.243209 32566 hybrid_clock.cc:648] HybridClock initialized: now 1786423857243180 us; error 45 us; skew 500 ppm
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:57.246687 32566 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:50:57.247712 32566 webserver.cc:460] Webserver started at http://127.17.188.66:45357/ using document root <none> and password file <none>
I20260811 04:50:57.248440 32566 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:57.248569 32566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:57.277498 32566 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.003s sys 0.000s
I20260811 04:50:57.281085 32585 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.282850 32566 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:50:57.283044 32566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "8a7bd0fcbd46456994ca7d4530f27cef"
format_stamp: "Formatted at 2026-08-11 04:50:55 on dist-test-slave-njxd"
server_key: "fd385ee1b79f670396f56336040ae277"
server_key_iv: "4a869315d999c9497e9cb522c8e11ada"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:57.283921 32566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:57.302069 32566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:57.305771 32566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:57.306027 32566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:57.306811 32566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:57.307816 32566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:57.307871 32566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.307922 32566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:57.307943 32566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.318614 32566 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:40781
I20260811 04:50:57.319900 32566 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:50:57.320734 32710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:40781 every 8 connection(s)
I20260811 04:50:57.327687 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32566
I20260811 04:50:57.328176 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.17.188.84:38155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:40705
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:34603
--webserver_port=43945
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:57.339169 32568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.323637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44697 (local address 127.17.188.126:34603)
0811 04:50:57.323787 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:57.323792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:57.324244 (+ 452us) server_negotiation.cc:407] Connection header received
0811 04:50:57.325539 (+ 1295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:57.325542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:57.325637 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:57.325698 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:57.327331 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.328173 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.330208 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.330607 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.330690 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.333835 (+ 3145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:57.333839 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:57.333842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:57.333871 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:57.335860 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.337290 (+ 1430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.337294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.337296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.337383 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.337829 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.337832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.337834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.338069 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:57.338147 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:57.338841 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 04:50:57.338980 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:50:57.341046 32713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.322491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.66:44697)
0811 04:50:57.324084 (+ 1593us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:57.324139 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:57.325264 (+ 1125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:57.326114 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:57.326125 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:57.326469 (+ 344us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:57.327147 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.327169 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.328588 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.328593 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.330061 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.330073 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.330903 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.330907 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.331101 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.331825 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:57.331846 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:57.333639 (+ 1793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:57.336780 (+ 3141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.336786 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.336803 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.337163 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.337494 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.337497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.337499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.337708 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.338235 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:57.338241 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:57.338539 (+ 298us) client_negotiation.cc:769] Sending connection context
0811 04:50:57.339431 (+ 892us) client_negotiation.cc:240] Negotiation successful
0811 04:50:57.339797 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1377,"thread_start_us":142,"threads_started":1}
I20260811 04:50:57.342530 32711 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:57.342823 32711 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.343503 32711 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.345260 32711 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:34603 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 04:50:57.345394 32711 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.345562 32711 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:57.346421 32711 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.346603 32711 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.347384 32711 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 04:50:57.479110 32714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:50:57.479409 32714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:50:57.479526 32714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:50:57.483805 32714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:50:57.483886 32714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:50:57.483971 32714 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:50:57.489786 32714 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.17.188.84:38155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:40705
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=43945
--tserver_master_addrs=127.17.188.126:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32714
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:50:57.491107 32714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:50:57.492405 32714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:50:57.506100 32714 server_base.cc:1034] running on GCE node
W20260811 04:50:57.506999 32722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:57.507109 32724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:50:57.509856 32721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:50:57.510456 32714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:50:57.511337 32714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:50:57.512537 32714 hybrid_clock.cc:648] HybridClock initialized: now 1786423857512506 us; error 50 us; skew 500 ppm
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:57.516131 32714 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:50:57.517259 32714 webserver.cc:460] Webserver started at http://127.17.188.67:43945/ using document root <none> and password file <none>
I20260811 04:50:57.518014 32714 fs_manager.cc:359] Metadata directory not provided
I20260811 04:50:57.518119 32714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:57.536397 32714 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260811 04:50:57.539463 32733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.540973 32714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 04:50:57.541150 32714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "f9e1016977f14fab80150ca3d0ebafd5"
format_stamp: "Formatted at 2026-08-11 04:50:56 on dist-test-slave-njxd"
server_key: "ce86a595cf91eaac9f8d84e7964dbfe8"
server_key_iv: "45db62d28a9a04b4b06c66fbd29e341a"
server_key_version: "kuduclusterkey@0"
I20260811 04:50:57.541867 32714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:50:57.564675 32714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:50:57.568223 32714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:50:57.568444 32714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:50:57.569118 32714 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:50:57.570102 32714 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:50:57.570170 32714 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.570237 32714 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:50:57.570286 32714 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:50:57.583899 32714 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:40705
I20260811 04:50:57.585072 32714 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:50:57.585768 391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:40705 every 8 connection(s)
I20260811 04:50:57.588182 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 32714
I20260811 04:50:57.603952 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.588856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46628 (local address 127.17.188.126:34603)
0811 04:50:57.589141 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:57.589146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:57.589368 (+ 222us) server_negotiation.cc:407] Connection header received
0811 04:50:57.589534 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:57.589537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:57.589633 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:57.594759 (+ 5126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:57.595048 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.595859 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.597141 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.597487 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.599466 (+ 1979us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.599599 (+ 133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:57.599603 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:57.599606 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:57.599625 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:57.601475 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.602025 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.602028 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.602030 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.602133 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.602455 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.602458 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.602460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.602670 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:57.603565 (+ 895us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:57.603648 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 04:50:57.603770 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":76,"threads_started":1}
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:50:57.614145 32568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.587655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:48003 (local address 127.17.188.126:34603)
0811 04:50:57.587830 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:57.587835 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:57.589938 (+ 2103us) server_negotiation.cc:407] Connection header received
0811 04:50:57.591239 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:57.591243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:57.591290 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:57.591344 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:57.592947 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.593807 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.603295 (+ 9488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.603670 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.603759 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.610159 (+ 6400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:57.610163 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:57.610165 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:57.610196 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:57.611875 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.612461 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.612465 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.612467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.612556 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:57.612951 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:57.612954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:57.612955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:57.613143 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:57.613252 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:57.613857 (+ 605us) server_negotiation.cc:299] Negotiation successful
0811 04:50:57.613981 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 04:50:57.615101 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:57.588115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34603 (local address 127.17.188.67:48003)
0811 04:50:57.589792 (+ 1677us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:57.589848 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:57.590981 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:57.591751 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:57.591760 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:57.592124 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:50:57.592764 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.592782 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.601530 (+ 8748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.601535 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.603135 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:57.603150 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:57.603977 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:57.603982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:57.605329 (+ 1347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:57.605965 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:50:57.605987 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:50:57.609960 (+ 3973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:50:57.612009 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.612038 (+ 29us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.612056 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.612345 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.612673 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:50:57.612676 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:50:57.612678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:50:57.612843 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:50:57.613252 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:50:57.613260 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:50:57.613533 (+ 273us) client_negotiation.cc:769] Sending connection context
0811 04:50:57.613798 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 04:50:57.614148 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1422,"thread_start_us":167,"threads_started":1}
I20260811 04:50:57.616448 392 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34603
I20260811 04:50:57.616705 392 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.617240 392 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.619064 392 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:34603 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 04:50:57.619194 392 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.619359 392 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:57.620216 392 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:57.620400 392 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
W20260811 04:50:57.621199 392 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 04:50:57 dist-test-slave-njxd krb5kdc[31249](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:50:58.087533 32564 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:58.087847 32564 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:58.088953 32349 ts_manager.cc:194] Registered new tserver with Master: 387d9e8786b643e2ba9d05872fa5d56a (127.17.188.65:40639)
I20260811 04:50:58.090674 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:58729
I20260811 04:50:58.347589 32711 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:58.347934 32711 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:58.348601 32349 ts_manager.cc:194] Registered new tserver with Master: 8a7bd0fcbd46456994ca7d4530f27cef (127.17.188.66:40781)
I20260811 04:50:58.349234 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:44697
Aug 11 04:50:58 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:58.621469 392 heartbeater.cc:464] Registering TS with master...
I20260811 04:50:58.621835 392 heartbeater.cc:511] Master 127.17.188.126:34603 requested a full tablet report, sending...
I20260811 04:50:58.622892 32349 ts_manager.cc:194] Registered new tserver with Master: f9e1016977f14fab80150ca3d0ebafd5 (127.17.188.67:40705)
I20260811 04:50:58.623682 32349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:48003
I20260811 04:50:58.634627 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:50:58.646557 414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.636447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.17.188.126:34603)
0811 04:50:58.636729 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.636734 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.637033 (+ 299us) server_negotiation.cc:407] Connection header received
0811 04:50:58.637166 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.637169 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.637227 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.637316 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:50:58.638314 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.639131 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.640326 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.640708 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.640806 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.642687 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:50:58.642691 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:50:58.642694 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:50:58.642723 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:50:58.644610 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:58.645136 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:58.645139 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:58.645141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:58.645232 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:50:58.645533 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:50:58.645537 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:50:58.645538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:50:58.645771 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:50:58.645899 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.646245 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.646382 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":96,"threads_started":1}
I20260811 04:50:58.652571 32349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46638:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:50:58.658812 32349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:50:58.683566 423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.671182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:40781 (local address 127.0.0.1:44814)
0811 04:50:58.673955 (+ 2773us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.674007 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:58.674146 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:58.678525 (+ 4379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:58.678531 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:58.678553 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:58.679035 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.679043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.680494 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.680498 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.681722 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.681733 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.683036 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.683040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.683159 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.683196 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 04:50:58.683300 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 04:50:58.683406 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2593,"thread_start_us":107,"threads_started":1}
I20260811 04:50:58.684567 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.671310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44814 (local address 127.17.188.66:40781)
0811 04:50:58.677838 (+ 6528us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.677845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.677870 (+ 25us) server_negotiation.cc:407] Connection header received
0811 04:50:58.677949 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.677954 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.678185 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.678344 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:58.679188 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.680337 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.681866 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.682725 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.682824 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.682974 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.684315 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.684417 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6403,"thread_start_us":66,"threads_started":1}
I20260811 04:50:58.685210 421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.673751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:40705 (local address 127.0.0.1:52008)
0811 04:50:58.674574 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.674586 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:58.674664 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:58.680902 (+ 6238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:58.680907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:58.680931 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:58.681067 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.681075 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.682483 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.682486 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.683565 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.683577 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.684832 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.684836 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.684922 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.684946 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 04:50:58.685020 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:50:58.685087 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":3,"thread_start_us":98,"threads_started":1}
I20260811 04:50:58.685760 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.674180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.17.188.67:40705)
0811 04:50:58.680192 (+ 6012us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.680199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.680226 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:50:58.680317 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.680322 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.680520 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.680699 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:58.681214 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.682336 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.683729 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.684499 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.684605 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.684765 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.685459 (+ 694us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.685558 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1792,"thread_start_us":73,"threads_started":1}
I20260811 04:50:58.688504 32767 tablet_service.cc:1467] Processing CreateTablet for tablet 250739f8ee73463aa8f93d5304d9b81e (DEFAULT_TABLE table=test-table [id=b8f4637a0ce04670b145a1e34f297552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:58.688251 32638 tablet_service.cc:1467] Processing CreateTablet for tablet 250739f8ee73463aa8f93d5304d9b81e (DEFAULT_TABLE table=test-table [id=b8f4637a0ce04670b145a1e34f297552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:58.689790 32638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 250739f8ee73463aa8f93d5304d9b81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:58.689798 32767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 250739f8ee73463aa8f93d5304d9b81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:58.708600 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.672409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40639 (local address 127.0.0.1:53794)
0811 04:50:58.681204 (+ 8795us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.681218 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:58.681386 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:58.682280 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:58.682285 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:58.682309 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:58.682430 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.682439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.685137 (+ 2698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.685142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.704396 (+ 19254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.704417 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.708094 (+ 3677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.708099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.708206 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.708232 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:50:58.708316 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:50:58.708405 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2047,"thread_start_us":97,"threads_started":1}
Aug 11 04:50:58 dist-test-slave-njxd krb5kdc[31249](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423857, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for HTTP/127.17.188.84@KRBTEST.COM
I20260811 04:50:58.709352 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.672809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53794 (local address 127.17.188.65:40639)
0811 04:50:58.674429 (+ 1620us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.674436 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.681308 (+ 6872us) server_negotiation.cc:407] Connection header received
0811 04:50:58.681675 (+ 367us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.681683 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.681907 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.682039 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:58.683501 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.684974 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.706791 (+ 21817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.707735 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.707857 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.708014 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.709004 (+ 990us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.709159 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1511,"thread_start_us":90,"threads_started":1}
I20260811 04:50:58.714147 428 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Bootstrap starting.
I20260811 04:50:58.714104 32491 tablet_service.cc:1467] Processing CreateTablet for tablet 250739f8ee73463aa8f93d5304d9b81e (DEFAULT_TABLE table=test-table [id=b8f4637a0ce04670b145a1e34f297552]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:50:58.715310 32491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 250739f8ee73463aa8f93d5304d9b81e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:50:58.716517 428 tablet_bootstrap.cc:654] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:58.717393 428 log.cc:824] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:58.722258 429 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Bootstrap starting.
I20260811 04:50:58.724597 429 tablet_bootstrap.cc:654] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:58.725414 429 log.cc:824] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:58.726646 431 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Bootstrap starting.
I20260811 04:50:58.727823 428 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: No bootstrap required, opened a new log
I20260811 04:50:58.728042 428 ts_tablet_manager.cc:1397] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.004s
I20260811 04:50:58.729367 431 tablet_bootstrap.cc:654] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Neither blocks nor log segments found. Creating new log.
I20260811 04:50:58.730434 431 log.cc:824] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:50:58.732663 428 raft_consensus.cc:348] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.732933 428 raft_consensus.cc:374] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:58.732975 428 raft_consensus.cc:729] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a7bd0fcbd46456994ca7d4530f27cef, State: Initialized, Role: FOLLOWER
I20260811 04:50:58.733449 428 consensus_queue.cc:260] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.733649 431 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: No bootstrap required, opened a new log
I20260811 04:50:58.733847 431 ts_tablet_manager.cc:1397] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 04:50:58.734720 428 ts_tablet_manager.cc:1428] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 04:50:58.735085 32711 heartbeater.cc:503] Master 127.17.188.126:34603 was elected leader, sending a full tablet report...
I20260811 04:50:58.738482 429 tablet_bootstrap.cc:492] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: No bootstrap required, opened a new log
I20260811 04:50:58.739027 429 ts_tablet_manager.cc:1397] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.002s
I20260811 04:50:58.740269 431 raft_consensus.cc:348] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.740573 431 raft_consensus.cc:374] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:58.740707 431 raft_consensus.cc:729] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 387d9e8786b643e2ba9d05872fa5d56a, State: Initialized, Role: FOLLOWER
I20260811 04:50:58.742542 431 consensus_queue.cc:260] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.744423 431 ts_tablet_manager.cc:1428] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260811 04:50:58.744824 32564 heartbeater.cc:503] Master 127.17.188.126:34603 was elected leader, sending a full tablet report...
I20260811 04:50:58.748100 429 raft_consensus.cc:348] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.748445 429 raft_consensus.cc:374] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:50:58.748525 429 raft_consensus.cc:729] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e1016977f14fab80150ca3d0ebafd5, State: Initialized, Role: FOLLOWER
I20260811 04:50:58.749013 429 consensus_queue.cc:260] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.749986 392 heartbeater.cc:503] Master 127.17.188.126:34603 was elected leader, sending a full tablet report...
I20260811 04:50:58.750469 429 ts_tablet_manager.cc:1428] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Time spent starting tablet: real 0.011s user 0.003s sys 0.004s
W20260811 04:50:58.803268 32565 tablet.cc:2369] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:50:58.803927 437 raft_consensus.cc:482] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:50:58.804121 437 raft_consensus.cc:504] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.805447 437 leader_election.cc:288] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8a7bd0fcbd46456994ca7d4530f27cef (127.17.188.66:40781), 387d9e8786b643e2ba9d05872fa5d56a (127.17.188.65:40639)
I20260811 04:50:58.817330 424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.806689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:58181 (local address 127.17.188.65:40639)
0811 04:50:58.806816 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.806822 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.811690 (+ 4868us) server_negotiation.cc:407] Connection header received
0811 04:50:58.811915 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.811920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.811974 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.812025 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:58.812709 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.813562 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.815509 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.816112 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.816215 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.816268 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.817107 (+ 839us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.817194 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:50:58.817903 441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.805998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40639 (local address 127.17.188.67:58181)
0811 04:50:58.811568 (+ 5570us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.811595 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:58.811783 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:58.812185 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:58.812188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:58.812210 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:58.812549 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.812560 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.813750 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.813753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.815360 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.815371 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.816368 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.816371 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.816543 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.816568 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:50:58.817606 (+ 1038us) client_negotiation.cc:240] Negotiation successful
0811 04:50:58.817689 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5481,"thread_start_us":242,"threads_started":1}
I20260811 04:50:58.818796 32515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "250739f8ee73463aa8f93d5304d9b81e" candidate_uuid: "f9e1016977f14fab80150ca3d0ebafd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387d9e8786b643e2ba9d05872fa5d56a" is_pre_election: true
I20260811 04:50:58.819161 32515 raft_consensus.cc:2454] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e1016977f14fab80150ca3d0ebafd5 in term 0.
I20260811 04:50:58.819799 32734 leader_election.cc:302] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387d9e8786b643e2ba9d05872fa5d56a, f9e1016977f14fab80150ca3d0ebafd5; no voters:
I20260811 04:50:58.820155 437 raft_consensus.cc:2781] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:50:58.820257 437 raft_consensus.cc:482] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:50:58.820314 437 raft_consensus.cc:3037] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:58.822489 437 raft_consensus.cc:504] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
W20260811 04:50:58.822675 32712 tablet.cc:2369] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:50:58.822927 437 leader_election.cc:288] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [CANDIDATE]: Term 1 election: Requested vote from peers 8a7bd0fcbd46456994ca7d4530f27cef (127.17.188.66:40781), 387d9e8786b643e2ba9d05872fa5d56a (127.17.188.65:40639)
I20260811 04:50:58.823438 32515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "250739f8ee73463aa8f93d5304d9b81e" candidate_uuid: "f9e1016977f14fab80150ca3d0ebafd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "387d9e8786b643e2ba9d05872fa5d56a"
I20260811 04:50:58.823578 32515 raft_consensus.cc:3037] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:58.825304 32515 raft_consensus.cc:2454] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e1016977f14fab80150ca3d0ebafd5 in term 1.
I20260811 04:50:58.825663 32734 leader_election.cc:302] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 387d9e8786b643e2ba9d05872fa5d56a, f9e1016977f14fab80150ca3d0ebafd5; no voters:
I20260811 04:50:58.825841 437 raft_consensus.cc:2781] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:50:58.826071 437 raft_consensus.cc:686] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 1 LEADER]: Becoming Leader. State: Replica: f9e1016977f14fab80150ca3d0ebafd5, State: Running, Role: LEADER
I20260811 04:50:58.826449 437 consensus_queue.cc:237] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } }
I20260811 04:50:58.830426 32348 catalog_manager.cc:5495] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9e1016977f14fab80150ca3d0ebafd5 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "f9e1016977f14fab80150ca3d0ebafd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9e1016977f14fab80150ca3d0ebafd5" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 40705 } health_report { overall_health: HEALTHY } } }
I20260811 04:50:58.834764 422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.807170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:54073 (local address 127.17.188.66:40781)
0811 04:50:58.807356 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.807361 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.817021 (+ 9660us) server_negotiation.cc:407] Connection header received
0811 04:50:58.829699 (+ 12678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.829704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.829763 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.829811 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:50:58.830474 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.831272 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.833277 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.833955 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.834049 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.834103 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.834535 (+ 432us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.834643 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 04:50:58.835256 442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.807038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:40781 (local address 127.17.188.67:54073)
0811 04:50:58.816905 (+ 9867us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.816920 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:50:58.829495 (+ 12575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:50:58.829955 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:50:58.829959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:50:58.829977 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:50:58.830221 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.830230 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.831416 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.831420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.833132 (+ 1712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:50:58.833143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.834211 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.834214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:50:58.834380 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.834406 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:50:58.834972 (+ 566us) client_negotiation.cc:240] Negotiation successful
0811 04:50:58.835055 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9789,"thread_start_us":237,"threads_started":1}
I20260811 04:50:58.836175 32659 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "250739f8ee73463aa8f93d5304d9b81e" candidate_uuid: "f9e1016977f14fab80150ca3d0ebafd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" is_pre_election: true
I20260811 04:50:58.836576 32659 raft_consensus.cc:2454] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9e1016977f14fab80150ca3d0ebafd5 in term 0.
I20260811 04:50:58.837052 32658 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "250739f8ee73463aa8f93d5304d9b81e" candidate_uuid: "f9e1016977f14fab80150ca3d0ebafd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8a7bd0fcbd46456994ca7d4530f27cef"
I20260811 04:50:58.837172 32658 raft_consensus.cc:3037] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:50:58.838991 32658 raft_consensus.cc:2454] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9e1016977f14fab80150ca3d0ebafd5 in term 1.
W20260811 04:50:58.839315 393 tablet.cc:2369] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:50:58.874199 426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.868733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52020 (local address 127.17.188.67:40705)
0811 04:50:58.868877 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:50:58.868881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:50:58.868900 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:50:58.868989 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:50:58.868992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:50:58.869057 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:50:58.869200 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:50:58.869482 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.870282 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.871562 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:50:58.871896 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:50:58.871997 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:50:58.872417 (+ 420us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:50:58.873072 (+ 655us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:50:58.873303 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 04:50:58.873837 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 04:50:58.873902 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:50:58.881489 32515 raft_consensus.cc:1261] T 250739f8ee73463aa8f93d5304d9b81e P 387d9e8786b643e2ba9d05872fa5d56a [term 1 FOLLOWER]: Refusing update from remote peer f9e1016977f14fab80150ca3d0ebafd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:50:58.882377 443 consensus_queue.cc:1035] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "387d9e8786b643e2ba9d05872fa5d56a" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:50:58.889752 32658 raft_consensus.cc:1261] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 1 FOLLOWER]: Refusing update from remote peer f9e1016977f14fab80150ca3d0ebafd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:50:58.890407 443 consensus_queue.cc:1035] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a7bd0fcbd46456994ca7d4530f27cef" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 40781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:50:58.910455 446 mvcc.cc:205] Tried to move back new op lower bound from 7317192125968793600 to 7317192125755981824. Current Snapshot: MvccSnapshot[applied={T|T < 7317192125968793600}]
I20260811 04:50:58.916287 449 mvcc.cc:205] Tried to move back new op lower bound from 7317192125968793600 to 7317192125755981824. Current Snapshot: MvccSnapshot[applied={T|T < 7317192125968793600}]
I20260811 04:50:58.916540 447 mvcc.cc:205] Tried to move back new op lower bound from 7317192125968793600 to 7317192125755981824. Current Snapshot: MvccSnapshot[applied={T|T < 7317192125968793600}]
I20260811 04:50:58.930513 32348 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:50:58.930706 32348 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46638:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:50:58.933295 32348 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9ab6b5450b1e4eaa879320d2f28015c0: Sending DeleteTablet for 3 replicas of tablet 250739f8ee73463aa8f93d5304d9b81e
I20260811 04:50:58.934437 32491 tablet_service.cc:1514] Processing DeleteTablet for tablet 250739f8ee73463aa8f93d5304d9b81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:58 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:53794
I20260811 04:50:58.934736 32638 tablet_service.cc:1514] Processing DeleteTablet for tablet 250739f8ee73463aa8f93d5304d9b81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:58 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:44814
I20260811 04:50:58.935329 32767 tablet_service.cc:1514] Processing DeleteTablet for tablet 250739f8ee73463aa8f93d5304d9b81e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:50:58 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:52008
I20260811 04:50:58.935639 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32392
I20260811 04:50:58.941198 457 tablet_replica.cc:330] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: stopping tablet replica
I20260811 04:50:58.941941 458 tablet_replica.cc:330] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: stopping tablet replica
I20260811 04:50:58.942242 458 raft_consensus.cc:2229] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:50:58.942632 458 raft_consensus.cc:2258] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:50:58.941592 457 raft_consensus.cc:2229] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:50:58.946127 457 raft_consensus.cc:2258] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:50:58.947907 458 ts_tablet_manager.cc:1905] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:50:58.951015 458 ts_tablet_manager.cc:1918] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:50:58.951139 458 log.cc:1196] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/250739f8ee73463aa8f93d5304d9b81e
I20260811 04:50:58.951506 458 ts_tablet_manager.cc:1939] T 250739f8ee73463aa8f93d5304d9b81e P f9e1016977f14fab80150ca3d0ebafd5: Deleting consensus metadata
I20260811 04:50:58.952838 32333 catalog_manager.cc:4841] TS f9e1016977f14fab80150ca3d0ebafd5 (127.17.188.67:40705): tablet 250739f8ee73463aa8f93d5304d9b81e (table test-table [id=b8f4637a0ce04670b145a1e34f297552]) successfully deleted
I20260811 04:50:58.955580 457 ts_tablet_manager.cc:1905] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 04:50:58.957371 32332 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:40639 (error 108)
I20260811 04:50:58.958600 457 ts_tablet_manager.cc:1918] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:50:58.958706 457 log.cc:1196] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/250739f8ee73463aa8f93d5304d9b81e
I20260811 04:50:58.958926 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32566
I20260811 04:50:58.959029 457 ts_tablet_manager.cc:1939] T 250739f8ee73463aa8f93d5304d9b81e P 8a7bd0fcbd46456994ca7d4530f27cef: Deleting consensus metadata
I20260811 04:50:58.968907 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32714
I20260811 04:50:58.969012 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.968673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40639 (local address 127.0.0.1:53806)
0811 04:50:58.968833 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.968913 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:40639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 04:50:58.973268 32332 catalog_manager.cc:4584] TS 387d9e8786b643e2ba9d05872fa5d56a (127.17.188.65:40639): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 250739f8ee73463aa8f93d5304d9b81e: Network error: Client connection negotiation failed: client connection to 127.17.188.65:40639: connect: Connection refused (error 111)
I20260811 04:50:58.974323 425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:50:58.974014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:40781 (local address 127.0.0.1:44828)
0811 04:50:58.974170 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 04:50:58.974232 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.66:40781: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 04:50:58.980612 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 32313
I20260811 04:50:58.990984 18161 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 04:50:59.335600 18161 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 04:50:59.335718 18161 mini_ranger.cc:66] Stopping Ranger...
I20260811 04:50:59.680893 18161 mini_ranger.cc:68] Stopped Ranger
2026-08-11 04:50:59.681 UTC [31280] LOG: received smart shutdown request
2026-08-11 04:50:59.685 UTC [31280] LOG: background worker "logical replication launcher" (PID 31289) exited with exit code 1
2026-08-11 04:50:59.685 UTC [31284] LOG: shutting down
2026-08-11 04:50:59.845 UTC [31280] LOG: database system is shut down
2026-08-11T04:50:59Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (48371 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:51:00 dist-test-slave-njxd krb5kdc[469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:51:00 dist-test-slave-njxd krb5kdc[469](info): set up 2 sockets
Aug 11 04:51:00 dist-test-slave-njxd krb5kdc[469](info): commencing operation
krb5kdc: starting...
W20260811 04:51:01.081122 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:51:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:51:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:51:01.208793 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38173
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:01.321842 483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:01.322160 483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:01.322257 483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:01.326303 483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:01.326381 483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:01.326419 483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:01.326478 483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:01.326519 483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:01.331715 483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:38173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:01.332816 483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:01.333954 483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:01.342604 488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.342628 489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.342604 491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:01.342875 483 server_base.cc:1034] running on GCE node
I20260811 04:51:01.343542 483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:01.344607 483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:01.345798 483 hybrid_clock.cc:648] HybridClock initialized: now 1786423861345780 us; error 30 us; skew 500 ppm
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:01.348436 483 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:01.349321 483 webserver.cc:460] Webserver started at http://127.17.188.126:36941/ using document root <none> and password file <none>
I20260811 04:51:01.349927 483 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:01.350015 483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:01.350246 483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:01.352284 483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "596a2fd0005648feb92a58c884c9c154"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "763efd8a3f0e0c9bc4f71b2032dda396"
server_key_iv: "3c9a5db2664426a8c05203fa3a9ecca7"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.352855 483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "596a2fd0005648feb92a58c884c9c154"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "763efd8a3f0e0c9bc4f71b2032dda396"
server_key_iv: "3c9a5db2664426a8c05203fa3a9ecca7"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.356451 483 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:51:01.358903 498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:01.360061 483 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:01.360199 483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "596a2fd0005648feb92a58c884c9c154"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "763efd8a3f0e0c9bc4f71b2032dda396"
server_key_iv: "3c9a5db2664426a8c05203fa3a9ecca7"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.360309 483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:01.383337 483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:01.386241 483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:01.386451 483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:01.393829 483 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:38173
I20260811 04:51:01.394132 554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:38173 every 8 connection(s)
I20260811 04:51:01.394876 483 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:01.397719 555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:01.401455 555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.405045 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 483
I20260811 04:51:01.405180 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:51:01.405468 18161 external_mini_cluster.cc:1428] Setting key 5c14d7a0152426b1eedd310a18f789bc
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.125@KRBTEST.COM" created.
I20260811 04:51:01.417328 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.403952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38173 (local address 127.0.0.1:50794)
0811 04:51:01.404579 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.404621 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.405626 (+ 1005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.406350 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.406355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.406792 (+ 437us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.407045 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.407058 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.408305 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.408308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.409031 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.409040 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.409789 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.409793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.409984 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.410601 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.410619 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.412112 (+ 1493us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.414176 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.414186 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.414196 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.414420 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.414772 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.414775 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.414777 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.414898 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.415574 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.415580 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.415758 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.415966 (+ 208us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.416313 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":94,"thread_start_us":159,"threads_started":1}
I20260811 04:51:01.417330 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.403952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50794 (local address 127.17.188.126:38173)
0811 04:51:01.404501 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.404521 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.404728 (+ 207us) server_negotiation.cc:407] Connection header received
0811 04:51:01.405956 (+ 1228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.405961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.406156 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.406351 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.407212 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.408141 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.409165 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.409545 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.409888 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.412270 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.412276 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.412286 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.412305 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.414034 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.414534 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.414540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.414541 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.414658 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.414998 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.415003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.415005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.415448 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.415592 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.416030 (+ 438us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.416264 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":356,"spinlock_wait_cycles":43264,"thread_start_us":174,"threads_started":1}
I20260811 04:51:01.420246 555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.421011 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.420731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42346)
0811 04:51:01.420865 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.420948 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 04:51:01.421208 503 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
I20260811 04:51:01.422052 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.421844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42352)
0811 04:51:01.421947 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.421993 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 04:51:01.422215 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:41971: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
I20260811 04:51:01.432787 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:41971
--webserver_interface=127.17.188.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:01.471462 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } attempt: 1
I20260811 04:51:01.472429 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.472064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42358)
0811 04:51:01.472250 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.472332 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260811 04:51:01.473301 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.473062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42360)
0811 04:51:01.473178 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.473234 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 04:51:01.473482 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:41971: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
I20260811 04:51:01.541656 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } attempt: 2
I20260811 04:51:01.542675 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.542306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42370)
0811 04:51:01.542496 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.542571 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 04:51:01.543452 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.543210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42376)
0811 04:51:01.543340 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.543393 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 04:51:01.543602 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:41971: Network error: Client connection negotiation failed: client connection to 127.17.188.125:41971: connect: Connection refused (error 111)
W20260811 04:51:01.547227 562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:01.547456 562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:01.547494 562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:01.551648 562 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:01.551703 562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:01.551723 562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:01.551774 562 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:01.551812 562 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:01.557126 562 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:41971
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.188.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:01.558307 562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:01.559406 562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:01.568023 569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.568080 570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.568029 572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:01.568298 562 server_base.cc:1034] running on GCE node
I20260811 04:51:01.568949 562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:01.570111 562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:01.571276 562 hybrid_clock.cc:648] HybridClock initialized: now 1786423861571260 us; error 27 us; skew 500 ppm
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:01.574102 562 init.cc:377] Logged in from keytab as kudu/127.17.188.125@KRBTEST.COM (short username kudu)
I20260811 04:51:01.575045 562 webserver.cc:460] Webserver started at http://127.17.188.125:40299/ using document root <none> and password file <none>
I20260811 04:51:01.575608 562 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:01.575712 562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:01.575958 562 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:01.578073 562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data/instance:
uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "48666db8560e32a12228300c9868a6b2"
server_key_iv: "24dc8d05b4852fc04baafa28f25db9af"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.578632 562 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal/instance:
uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "48666db8560e32a12228300c9868a6b2"
server_key_iv: "24dc8d05b4852fc04baafa28f25db9af"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.582330 562 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:51:01.584666 579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:01.585870 562 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:01.586011 562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "48666db8560e32a12228300c9868a6b2"
server_key_iv: "24dc8d05b4852fc04baafa28f25db9af"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.586117 562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:01.605154 562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:01.608095 562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:01.608321 562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:01.615608 562 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.125:41971
I20260811 04:51:01.615890 634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.125:41971 every 8 connection(s)
I20260811 04:51:01.616588 562 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
I20260811 04:51:01.619396 635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:01.619776 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 562
I20260811 04:51:01.619921 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-1/wal/instance
I20260811 04:51:01.620218 18161 external_mini_cluster.cc:1428] Setting key 624c47927c24188b08021a26b2428c98
I20260811 04:51:01.623309 635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.188.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.124@KRBTEST.COM" created.
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:01.634799 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } attempt: 3
I20260811 04:51:01.637214 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.625212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46116 (local address 127.17.188.126:38173)
0811 04:51:01.625376 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.625382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.626284 (+ 902us) server_negotiation.cc:407] Connection header received
0811 04:51:01.627227 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.627230 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.627287 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.627393 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.628566 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.629148 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.630463 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.630710 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.630822 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.633329 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.633332 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.633334 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.633357 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.634966 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.635594 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.635598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.635600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.635709 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.636042 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.636049 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.636051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.636267 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.636379 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.636908 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.637039 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 04:51:01.638221 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.625614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38173 (local address 127.0.0.1:46116)
0811 04:51:01.626122 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.626174 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.626985 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.627564 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.627571 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.627933 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.628415 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.628428 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.629285 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.629289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.630328 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.630339 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.630866 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.630870 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.631043 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.631626 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.631643 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.633154 (+ 1511us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.635082 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.635088 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.635103 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.635466 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.635817 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.635819 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.635821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.635945 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.636410 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.636417 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.636664 (+ 247us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.636854 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.637175 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":136,"threads_started":1}
I20260811 04:51:01.640138 635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:51:01.648495 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.635256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42378)
0811 04:51:01.635463 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.635480 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.635559 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.636344 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.636350 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.636560 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.636709 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.636717 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.639006 (+ 2289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.639009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.639933 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.639945 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.641174 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.641181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.641321 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.641843 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.641863 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.644091 (+ 2228us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.646493 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.646496 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.646497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.646792 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.647225 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.647228 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.647230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.647321 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.647927 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.647929 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.648044 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.648163 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.648328 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
I20260811 04:51:01.648748 640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.635343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42378 (local address 127.17.188.125:41971)
0811 04:51:01.635833 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.635847 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.635873 (+ 26us) server_negotiation.cc:407] Connection header received
0811 04:51:01.635929 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.635938 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.636172 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.636878 (+ 706us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.637040 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.638861 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.640486 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.641044 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.641159 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.644221 (+ 3062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.644231 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.644245 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.644260 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.646384 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.646926 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.646950 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.646952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.647111 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.647422 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.647426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.647428 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.647816 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.647968 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.648327 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.648520 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":149,"threads_started":1}
I20260811 04:51:01.649703 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:36825
--webserver_interface=127.17.188.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:01.650584 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.640622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42392)
0811 04:51:01.640773 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.640787 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.640859 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.641338 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.641341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.641522 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.641665 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.641675 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.642720 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.642723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.643461 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.643477 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.644117 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.644121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.644240 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.644681 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.644692 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.646273 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.649037 (+ 2764us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.649043 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.649046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.649233 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.649516 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.649519 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.649521 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.649673 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.650075 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.650078 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.650157 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.650265 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.650405 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 04:51:01.650629 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.640793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42392 (local address 127.17.188.125:41971)
0811 04:51:01.641114 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.641137 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.641150 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:51:01.641180 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.641183 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.641224 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.641331 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.641791 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.642587 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.643608 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.643978 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.644063 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.646401 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.646406 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.646412 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.646442 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.648950 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.649331 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.649335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.649337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.649419 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.649772 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.649777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.649779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.649992 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.650084 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.650323 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.650464 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":245,"thread_start_us":103,"threads_started":1}
I20260811 04:51:01.652897 555 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.653056 635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.653771 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.653412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44742)
0811 04:51:01.653605 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.653681 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 04:51:01.653797 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.653479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44758)
0811 04:51:01.653681 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.653745 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260811 04:51:01.654001 581 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.654732 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.654405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44770)
0811 04:51:01.654607 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.654661 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113}
W20260811 04:51:01.654904 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.654991 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.654701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44776)
0811 04:51:01.654868 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.654918 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":31}
W20260811 04:51:01.655138 635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.686061 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 1
I20260811 04:51:01.687007 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.686691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44788)
0811 04:51:01.686855 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.686923 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 04:51:01.687775 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.687556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44794)
0811 04:51:01.687672 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.687717 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 04:51:01.687961 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.704443 635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 1
I20260811 04:51:01.705327 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.705024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44804)
0811 04:51:01.705173 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.705246 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 04:51:01.706168 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.705933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44808)
0811 04:51:01.706055 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.706110 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 04:51:01.706347 635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.763172 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 2
I20260811 04:51:01.764161 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.763752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44816)
0811 04:51:01.763967 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.764050 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 04:51:01.764930 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.764697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44818)
0811 04:51:01.764829 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.764880 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 04:51:01.765054 555 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
W20260811 04:51:01.766417 642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:01.766692 642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:01.766801 642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:01.770810 642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:01.770885 642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:01.770933 642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:01.770974 642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:01.771026 642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:01.774523 635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 2
I20260811 04:51:01.775259 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.774983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44822)
0811 04:51:01.775119 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.775171 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 04:51:01.775961 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.775747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44832)
0811 04:51:01.775858 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.775909 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 04:51:01.776101 635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36825: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36825: connect: Connection refused (error 111)
I20260811 04:51:01.776780 642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:38173,127.17.188.125:41971,127.17.188.124:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:36825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.188.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:01.777918 642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:01.778924 642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:01.787178 653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.787164 649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:01.787288 650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:01.787395 642 server_base.cc:1034] running on GCE node
I20260811 04:51:01.788082 642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:01.789081 642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:01.790275 642 hybrid_clock.cc:648] HybridClock initialized: now 1786423861790261 us; error 25 us; skew 500 ppm
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:01.793085 642 init.cc:377] Logged in from keytab as kudu/127.17.188.124@KRBTEST.COM (short username kudu)
I20260811 04:51:01.794060 642 webserver.cc:460] Webserver started at http://127.17.188.124:40535/ using document root <none> and password file <none>
I20260811 04:51:01.794577 642 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:01.794636 642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:01.794808 642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:01.796768 642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data/instance:
uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "357a1288019272cd4fa34e9f7ef6ff07"
server_key_iv: "391cd9956174c558bd3fcd9f6145beb2"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.797292 642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal/instance:
uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "357a1288019272cd4fa34e9f7ef6ff07"
server_key_iv: "391cd9956174c558bd3fcd9f6145beb2"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.801033 642 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:51:01.803392 660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:01.804698 642 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 04:51:01.804826 642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a"
format_stamp: "Formatted at 2026-08-11 04:51:01 on dist-test-slave-njxd"
server_key: "357a1288019272cd4fa34e9f7ef6ff07"
server_key_iv: "391cd9956174c558bd3fcd9f6145beb2"
server_key_version: "encryptionkey@0"
I20260811 04:51:01.804965 642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:01.817178 642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:01.820029 642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:01.820227 642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:01.827342 642 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.124:36825
I20260811 04:51:01.827733 716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.124:36825 every 8 connection(s)
I20260811 04:51:01.828358 642 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
I20260811 04:51:01.831162 717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:01.834846 717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.838064 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 642
I20260811 04:51:01.838217 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786423695299078-18161-0/minicluster-data/master-2/wal/instance
I20260811 04:51:01.838533 18161 external_mini_cluster.cc:1428] Setting key 1f5038a22bb858e7658964b554dcd52d
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:01.850261 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.836689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.17.188.126:38173)
0811 04:51:01.836870 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.836873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.837774 (+ 901us) server_negotiation.cc:407] Connection header received
0811 04:51:01.839061 (+ 1287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.839065 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.839127 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.839215 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.840809 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.841363 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.842938 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.843263 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.843349 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.846254 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.846258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.846261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.846289 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.847820 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.848389 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.848393 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.848394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.848476 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.848859 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.848862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.848864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.849085 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.849162 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.849934 (+ 772us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.850085 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:51:01.851642 720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.837057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:38173 (local address 127.0.0.1:46130)
0811 04:51:01.837533 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.837644 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.838782 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.839476 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.839489 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.840016 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.840662 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.840677 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.841493 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.841496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.842793 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.842806 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.843543 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.843546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.843747 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.844348 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.844368 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.846092 (+ 1724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.847949 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.847954 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.847969 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.848277 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.848590 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.848593 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.848595 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.848758 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.849231 (+ 473us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.849238 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.849532 (+ 294us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.849822 (+ 290us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.850147 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":26,"thread_start_us":143,"threads_started":1}
I20260811 04:51:01.853266 717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:51:01.856360 722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.839431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44842 (local address 127.17.188.124:36825)
0811 04:51:01.839927 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.839938 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.839993 (+ 55us) server_negotiation.cc:407] Connection header received
0811 04:51:01.840063 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.840070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.840303 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.840467 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.841437 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.842789 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.843936 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.844468 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.844561 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.852527 (+ 7966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.852536 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.852570 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.852596 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.854520 (+ 1924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.855043 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.855048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.855049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.855131 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.855397 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.855399 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.855400 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.855657 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.855875 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.856008 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.856150 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":370,"thread_start_us":89,"threads_started":1}
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:51:01.861932 720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.853804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:41971 (local address 127.0.0.1:42404)
0811 04:51:01.853973 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.853987 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.854056 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.854288 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.854291 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.854506 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.854655 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.854661 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.855630 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.855634 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.856464 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.856476 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.856957 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.856960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.857051 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.857473 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.857484 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.858834 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.860541 (+ 1707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.860547 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.860549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.860731 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.861001 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.861004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.861005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.861083 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.861431 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.861434 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.861522 (+ 88us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.861667 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.861779 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 04:51:01.861984 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.853924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42404 (local address 127.17.188.125:41971)
0811 04:51:01.854067 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.854070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.854100 (+ 30us) server_negotiation.cc:407] Connection header received
0811 04:51:01.854139 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.854140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.854184 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.854242 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.854779 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.855508 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.856615 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.856845 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.856927 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.858952 (+ 2025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.858958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.858961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.858987 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.860431 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.860823 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.860826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.860828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.860912 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.861171 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.861174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.861176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.861339 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.861436 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.861718 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.861824 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:51:01.862726 717 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:01.864229 555 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 3
I20260811 04:51:01.867274 635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } attempt: 3
I20260811 04:51:01.869065 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.858569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46144 (local address 127.17.188.126:38173)
0811 04:51:01.858681 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.858684 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.858846 (+ 162us) server_negotiation.cc:407] Connection header received
0811 04:51:01.858963 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.858966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.859002 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.859056 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.859805 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.860261 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.860973 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.861174 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.861270 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.864168 (+ 2898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.864170 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.864172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.864226 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.866014 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.866445 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.866449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.866451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.866534 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.867527 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.867533 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.867538 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.867766 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.867983 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.868819 (+ 836us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.868926 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:51:01.874070 557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.864583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44864)
0811 04:51:01.864770 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.864785 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.864858 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.865246 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.865249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.865478 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.865578 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.865586 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.866833 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.866836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.867401 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.867411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.868011 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.868015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.868123 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.868712 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.868731 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.870143 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.872314 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.872318 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.872320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.872578 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.872907 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.872910 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.872912 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.872999 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.873509 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.873513 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.873640 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.873760 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.873903 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260811 04:51:01.875108 723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.864635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44864 (local address 127.17.188.124:36825)
0811 04:51:01.865055 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.865063 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.865075 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:51:01.865107 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.865110 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.865153 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.865227 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.865694 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.866711 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.867529 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.867875 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.868381 (+ 506us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.870318 (+ 1937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.870322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.870324 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.870353 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.872197 (+ 1844us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.872706 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.872710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.872712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.872797 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.873136 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.873142 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.873145 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.873354 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.873455 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.874708 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.874876 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":201,"server-negotiator.queue_time_us":367,"spinlock_wait_cycles":896,"thread_start_us":134,"threads_started":1}
I20260811 04:51:01.875830 720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.863258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44858)
0811 04:51:01.863350 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.863361 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.863444 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.863756 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.863762 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.863899 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.863961 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.863965 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.865187 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.865193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.866249 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.866262 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.868053 (+ 1791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.868057 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.868141 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.870733 (+ 2592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.870749 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.872345 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.874265 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.874268 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.874270 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.874480 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.874753 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.874756 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.874758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.874824 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.875302 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.875305 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.875389 (+ 84us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.875484 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.875644 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":20}
I20260811 04:51:01.876475 722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.863404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44858 (local address 127.17.188.124:36825)
0811 04:51:01.863499 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.863503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.863515 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:51:01.863546 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.863548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.863583 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.863661 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.864096 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.865047 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.866387 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.866711 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.866824 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.872467 (+ 5643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.872471 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.872474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.872500 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.874145 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.874590 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.874592 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.874594 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.874669 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.874902 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.874905 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.874907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.875162 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.875266 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.876146 (+ 880us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.876304 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 04:51:01 dist-test-slave-njxd krb5kdc[469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:51:01.878561 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.867628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36825 (local address 127.0.0.1:44866)
0811 04:51:01.867777 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:01.867792 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:01.867874 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:01.868768 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:01.868771 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:01.868943 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:01.869016 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.869021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.870354 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.870374 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.871276 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:01.871287 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.871992 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.871997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:01.872101 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.872568 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:01.872582 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:01.874157 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:01.876865 (+ 2708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.876872 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.876874 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.877147 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.877467 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:01.877471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:01.877473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:01.877574 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:01.878064 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:01.878067 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:01.878157 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 04:51:01.878239 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 04:51:01.878373 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 04:51:01.878947 555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: Bootstrap starting.
I20260811 04:51:01.879761 724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.868015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44866 (local address 127.17.188.124:36825)
0811 04:51:01.868577 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.868587 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.868596 (+ 9us) server_negotiation.cc:407] Connection header received
0811 04:51:01.868620 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.868622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.868649 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.868747 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.869250 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.870091 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.871445 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.871825 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.872344 (+ 519us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.874637 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.874642 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.874646 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.874684 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.876760 (+ 2076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.877287 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.877290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.877291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.877362 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.877746 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.877753 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.877754 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.877953 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.878872 (+ 919us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.878947 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.879330 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"spinlock_wait_cycles":5376,"thread_start_us":107,"threads_started":1}
I20260811 04:51:01.880484 717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: Bootstrap starting.
I20260811 04:51:01.882074 555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:01.882472 635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: Bootstrap starting.
I20260811 04:51:01.882570 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.870243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42416 (local address 127.17.188.125:41971)
0811 04:51:01.870387 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.870391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.870403 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:51:01.870502 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.870505 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.870541 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.870636 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.871952 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.873192 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.874602 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.875214 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.875306 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.878724 (+ 3418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.878728 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.878730 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.878753 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.880366 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.880849 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.880852 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.880854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.880929 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.881228 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.881231 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.881233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.881420 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.881626 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.882250 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.882360 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 04:51:01.882949 717 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:01.883430 555 log.cc:824] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:01.883720 717 log.cc:824] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:01.884930 635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:01.885725 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:51:01.885741 555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: No bootstrap required, opened a new log
I20260811 04:51:01.885773 635 log.cc:824] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:01.887791 635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: No bootstrap required, opened a new log
I20260811 04:51:01.889801 555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.890060 555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:01.890108 555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 596a2fd0005648feb92a58c884c9c154, State: Initialized, Role: FOLLOWER
I20260811 04:51:01.890616 555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.891848 555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:01.891956 635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.892163 635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:01.892218 635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ab954a0a7da4a4aa0c520a07a8ce7c1, State: Initialized, Role: FOLLOWER
I20260811 04:51:01.892686 635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.893461 736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:01.894321 736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:01.894606 635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:01.895342 717 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: No bootstrap required, opened a new log
I20260811 04:51:01.899670 558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.887928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.17.188.126:38173)
0811 04:51:01.888060 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.888067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.888426 (+ 359us) server_negotiation.cc:407] Connection header received
0811 04:51:01.888596 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.888599 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.888642 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.888692 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.889754 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.890533 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.891831 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.892182 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.892268 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.895201 (+ 2933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.895208 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.895215 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.895246 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.897645 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.898134 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.898137 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.898138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.898235 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.898528 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.898532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.898537 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.898747 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.898856 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.899427 (+ 571us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.899532 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:51:01.899739 717 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.899947 717 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:01.900010 717 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fa43d4d088447d2aa6e0da16bdc9b8a, State: Initialized, Role: FOLLOWER
I20260811 04:51:01.900508 717 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:01.901618 717 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:01.901748 641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.888457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42420 (local address 127.17.188.125:41971)
0811 04:51:01.888555 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.888559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.889048 (+ 489us) server_negotiation.cc:407] Connection header received
0811 04:51:01.889235 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.889239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.889279 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.889325 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.890375 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.891055 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.892151 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.892470 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.892544 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.894742 (+ 2198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.894746 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.894748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.894771 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.896877 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.900421 (+ 3544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.900424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.900427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.900509 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.900855 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.900858 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.900860 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.901058 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.901163 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.901481 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.901617 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:51:01.898221 483 master_runner.cc:186] Error getting master registration for 127.17.188.125:41971: OK, instance_id { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" instance_seqno: 1786423861613477 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:51:01.903985 483 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 04:51:01.905040 760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:01.905151 760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: This master's current role is: FOLLOWER
W20260811 04:51:01.907214 772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:51:01.907330 772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:51:01.902618 562 master_runner.cc:186] Error getting master registration for 127.17.188.124:36825: OK, instance_id { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" instance_seqno: 1786423861825338 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:51:01.907873 562 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 04:51:01.911230 642 master_runner.cc:263] No leader master found from master 4fa43d4d088447d2aa6e0da16bdc9b8a
I20260811 04:51:01.911284 642 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 04:51:01.912479 759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:51:01.912556 759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:51:01.912758 743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:01.912885 743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:01.915259 724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:01.905722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44874 (local address 127.17.188.124:36825)
0811 04:51:01.905890 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:01.905895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:01.905907 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:51:01.905941 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:01.905944 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:01.905981 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:01.906055 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:01.906904 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.907646 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.908917 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:01.909331 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:01.909430 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:01.911403 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:01.911407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:01.911409 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:01.911431 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:01.913379 (+ 1948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.913902 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.913907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.913911 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.914004 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:01.914343 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:01.914346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:01.914347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:01.914581 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:01.914717 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:01.914987 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 04:51:01.915108 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260811 04:51:01.920334 748 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:51:01.920426 748 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:51:02.009882 743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:02.010106 743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:02.011157 743 leader_election.cc:288] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 596a2fd0005648feb92a58c884c9c154 (127.17.188.126:38173), 4fa43d4d088447d2aa6e0da16bdc9b8a (127.17.188.124:36825)
I20260811 04:51:02.011788 687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" is_pre_election: true
I20260811 04:51:02.012109 687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab954a0a7da4a4aa0c520a07a8ce7c1 in term 0.
I20260811 04:51:02.012816 527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "596a2fd0005648feb92a58c884c9c154" is_pre_election: true
I20260811 04:51:02.013120 527 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ab954a0a7da4a4aa0c520a07a8ce7c1 in term 0.
I20260811 04:51:02.013654 581 leader_election.cc:302] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fa43d4d088447d2aa6e0da16bdc9b8a, 6ab954a0a7da4a4aa0c520a07a8ce7c1; no voters:
I20260811 04:51:02.014519 743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:51:02.014638 743 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:51:02.014691 743 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:02.016242 743 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:02.016855 527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "596a2fd0005648feb92a58c884c9c154"
I20260811 04:51:02.017020 527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:02.018401 527 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab954a0a7da4a4aa0c520a07a8ce7c1 in term 1.
I20260811 04:51:02.018721 583 leader_election.cc:302] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 596a2fd0005648feb92a58c884c9c154, 6ab954a0a7da4a4aa0c520a07a8ce7c1; no voters:
I20260811 04:51:02.020153 687 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a"
I20260811 04:51:02.020288 687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:02.021727 687 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ab954a0a7da4a4aa0c520a07a8ce7c1 in term 1.
I20260811 04:51:02.022111 743 leader_election.cc:288] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [CANDIDATE]: Term 1 election: Requested vote from peers 596a2fd0005648feb92a58c884c9c154 (127.17.188.126:38173), 4fa43d4d088447d2aa6e0da16bdc9b8a (127.17.188.124:36825)
I20260811 04:51:02.022313 743 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:02.022408 743 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [term 1 LEADER]: Becoming Leader. State: Replica: 6ab954a0a7da4a4aa0c520a07a8ce7c1, State: Running, Role: LEADER
I20260811 04:51:02.022733 743 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } }
I20260811 04:51:02.025740 776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ab954a0a7da4a4aa0c520a07a8ce7c1. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.025897 776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:02.029860 778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:02.030918 778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:02.036514 687 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [term 1 FOLLOWER]: Refusing update from remote peer 6ab954a0a7da4a4aa0c520a07a8ce7c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:02.037251 743 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:02.044139 760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ab954a0a7da4a4aa0c520a07a8ce7c1. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.044292 760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:02.045320 527 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [term 1 FOLLOWER]: Refusing update from remote peer 6ab954a0a7da4a4aa0c520a07a8ce7c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:02.045969 743 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:02.049512 736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ab954a0a7da4a4aa0c520a07a8ce7c1. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.049674 736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:02.053972 776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.054091 776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:02.054427 736 sys_catalog.cc:455] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.054533 736 sys_catalog.cc:458] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:02.054912 779 mvcc.cc:205] Tried to move back new op lower bound from 7317192138893668352 to 7317192138851598336. Current Snapshot: MvccSnapshot[applied={T|T < 7317192138893668352}]
I20260811 04:51:02.056411 782 mvcc.cc:205] Tried to move back new op lower bound from 7317192138893668352 to 7317192138851598336. Current Snapshot: MvccSnapshot[applied={T|T < 7317192138893668352}]
I20260811 04:51:02.057106 776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.057232 776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:02.058061 760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "596a2fd0005648feb92a58c884c9c154" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 38173 } } peers { permanent_uuid: "6ab954a0a7da4a4aa0c520a07a8ce7c1" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 41971 } } peers { permanent_uuid: "4fa43d4d088447d2aa6e0da16bdc9b8a" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36825 } } }
I20260811 04:51:02.058174 760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:51:02.064621 780 mvcc.cc:205] Tried to move back new op lower bound from 7317192138893668352 to 7317192138851598336. Current Snapshot: MvccSnapshot[applied={T|T < 7317192138893668352}]
I20260811 04:51:02.066244 778 catalog_manager.cc:1347] Generated new cluster ID: df2b8e7c3cd1494791fb03b86970d60b
I20260811 04:51:02.066311 778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:02.086061 778 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:51:02.087814 778 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:02.095429 778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ab954a0a7da4a4aa0c520a07a8ce7c1: Generated new TSK 0
I20260811 04:51:02.096210 778 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:51:02.908747 772 catalog_manager.cc:1259] Loaded cluster ID: df2b8e7c3cd1494791fb03b86970d60b
I20260811 04:51:02.908833 772 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: loading cluster ID for follower catalog manager: success
I20260811 04:51:02.910610 772 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: acquiring CA information for follower catalog manager: success
I20260811 04:51:02.911789 772 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4fa43d4d088447d2aa6e0da16bdc9b8a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:51:02.921689 748 catalog_manager.cc:1259] Loaded cluster ID: df2b8e7c3cd1494791fb03b86970d60b
I20260811 04:51:02.921756 748 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: loading cluster ID for follower catalog manager: success
I20260811 04:51:02.923472 748 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: acquiring CA information for follower catalog manager: success
I20260811 04:51:02.924646 748 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 596a2fd0005648feb92a58c884c9c154: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:51:03.154376 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 483
I20260811 04:51:03.163048 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 562
I20260811 04:51:03.171042 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 642
2026-08-11T04:51:03Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3200 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:51:03 dist-test-slave-njxd krb5kdc[795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:51:03 dist-test-slave-njxd krb5kdc[795](info): set up 2 sockets
Aug 11 04:51:03 dist-test-slave-njxd krb5kdc[795](info): commencing operation
krb5kdc: starting...
W20260811 04:51:04.266222 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:51:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:51:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:51:04.400300 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34779
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:40703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34779
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:04.513417 811 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:04.513741 811 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:04.513823 811 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:04.517784 811 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:04.517869 811 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:04.517908 811 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:04.517958 811 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:04.517997 811 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:04.523043 811 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:40703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.811
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:04.524067 811 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:04.525043 811 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:04.533445 819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:04.533452 816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:04.533733 811 server_base.cc:1034] running on GCE node
W20260811 04:51:04.533452 817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:04.534380 811 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:04.535422 811 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:04.536621 811 hybrid_clock.cc:648] HybridClock initialized: now 1786423864536591 us; error 40 us; skew 500 ppm
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423864, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:04.539502 811 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:04.540297 811 webserver.cc:460] Webserver started at http://127.17.188.126:33445/ using document root <none> and password file <none>
I20260811 04:51:04.540786 811 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:04.540841 811 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:04.540997 811 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:04.543010 811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "158076f04b1f4e3394adba295eeb1735"
format_stamp: "Formatted at 2026-08-11 04:51:04 on dist-test-slave-njxd"
server_key: "3d74e68eb6415ffe86dda1ae3f7d03b5"
server_key_iv: "f0448f17ef6677eb63491dda89ffa192"
server_key_version: "encryptionkey@0"
I20260811 04:51:04.543524 811 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "158076f04b1f4e3394adba295eeb1735"
format_stamp: "Formatted at 2026-08-11 04:51:04 on dist-test-slave-njxd"
server_key: "3d74e68eb6415ffe86dda1ae3f7d03b5"
server_key_iv: "f0448f17ef6677eb63491dda89ffa192"
server_key_version: "encryptionkey@0"
I20260811 04:51:04.547179 811 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:51:04.549474 827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:04.550719 811 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:04.550851 811 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "158076f04b1f4e3394adba295eeb1735"
format_stamp: "Formatted at 2026-08-11 04:51:04 on dist-test-slave-njxd"
server_key: "3d74e68eb6415ffe86dda1ae3f7d03b5"
server_key_iv: "f0448f17ef6677eb63491dda89ffa192"
server_key_version: "encryptionkey@0"
I20260811 04:51:04.550992 811 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:04.575239 811 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:04.578898 811 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:04.579070 811 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:04.586362 811 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34779
I20260811 04:51:04.586386 885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34779 every 8 connection(s)
I20260811 04:51:04.587374 811 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:04.590169 886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:04.595628 886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: Bootstrap starting.
I20260811 04:51:04.597710 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 811
I20260811 04:51:04.597828 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:51:04.598129 18161 external_mini_cluster.cc:1428] Setting key 175ecca49c6b75d4acf78b841557299f
I20260811 04:51:04.598264 886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:04.599068 886 log.cc:824] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:04.601043 886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: No bootstrap required, opened a new log
I20260811 04:51:04.604493 886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } }
I20260811 04:51:04.604763 886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:04.604856 886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158076f04b1f4e3394adba295eeb1735, State: Initialized, Role: FOLLOWER
I20260811 04:51:04.605355 886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } }
I20260811 04:51:04.605486 886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:04.605595 886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:04.605733 886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:04.606647 886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } }
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:04.607028 886 leader_election.cc:302] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 158076f04b1f4e3394adba295eeb1735; no voters:
I20260811 04:51:04.607414 886 leader_election.cc:288] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:51:04.607511 891 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:04.607761 891 raft_consensus.cc:686] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [term 1 LEADER]: Becoming Leader. State: Replica: 158076f04b1f4e3394adba295eeb1735, State: Running, Role: LEADER
I20260811 04:51:04.608170 891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } }
I20260811 04:51:04.608798 886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:04.609977 894 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 158076f04b1f4e3394adba295eeb1735. Latest consensus state: current_term: 1 leader_uuid: "158076f04b1f4e3394adba295eeb1735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } } }
I20260811 04:51:04.610114 894 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:04.610409 892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "158076f04b1f4e3394adba295eeb1735" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158076f04b1f4e3394adba295eeb1735" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34779 } } }
I20260811 04:51:04.610600 892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:04.613236 890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:04.599244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47330 (local address 127.17.188.126:34779)
0811 04:51:04.599749 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:04.599771 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:04.599816 (+ 45us) server_negotiation.cc:407] Connection header received
0811 04:51:04.600517 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:04.600533 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:04.600846 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:04.601170 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:04.602102 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:04.603059 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:04.603944 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:04.604422 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:04.604610 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:04.607444 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:04.607450 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:04.607469 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:04.607506 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:04.609762 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:04.610318 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:04.610326 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:04.610333 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:04.610483 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:04.610834 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:04.610837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:04.610839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:04.611366 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:04.611565 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:04.612041 (+ 476us) server_negotiation.cc:299] Negotiation successful
0811 04:51:04.612369 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"spinlock_wait_cycles":12032,"thread_start_us":154,"threads_started":1}
W20260811 04:51:04.613965 907 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:51:04.614045 907 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:51:04.614127 901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:04.615015 901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:04.615995 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:51:04.620718 901 catalog_manager.cc:1347] Generated new cluster ID: b35490fa13324ee5b8132c5d4e1d7cd3
I20260811 04:51:04.620807 901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:04.638228 901 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:51:04.639214 901 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:04.647918 901 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 158076f04b1f4e3394adba295eeb1735: Generated new TSK 0
I20260811 04:51:04.648615 901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:51:04.672266 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 811
2026-08-11T04:51:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1499 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[914](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[914](info): set up 2 sockets
Aug 11 04:51:04 dist-test-slave-njxd krb5kdc[914](info): commencing operation
krb5kdc: starting...
W20260811 04:51:05.776332 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:51:05 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:51:05.923985 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:06.033171 928 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:06.033465 928 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:06.033536 928 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:06.037513 928 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:06.037621 928 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:06.037672 928 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:06.037711 928 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:06.037750 928 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:06.042924 928 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.928
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:06.043987 928 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:06.044986 928 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:06.053382 933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:06.053375 936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.053529 928 server_base.cc:1034] running on GCE node
W20260811 04:51:06.053614 934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.054284 928 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:06.055332 928 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:06.056509 928 hybrid_clock.cc:648] HybridClock initialized: now 1786423866056489 us; error 30 us; skew 500 ppm
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:06.059242 928 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:06.060132 928 webserver.cc:460] Webserver started at http://127.17.188.126:33893/ using document root <none> and password file <none>
I20260811 04:51:06.060648 928 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:06.060706 928 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:06.060936 928 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:06.062969 928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "4fc3bd2382814daaa4df8b082f055f5c"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "91678c06e796259bb5364c1c90dbfbc8"
server_key_iv: "ada07985cd23da089590d968a28f2b71"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.063534 928 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "4fc3bd2382814daaa4df8b082f055f5c"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "91678c06e796259bb5364c1c90dbfbc8"
server_key_iv: "ada07985cd23da089590d968a28f2b71"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.067181 928 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 04:51:06.069442 943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.070763 928 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:51:06.070909 928 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "4fc3bd2382814daaa4df8b082f055f5c"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "91678c06e796259bb5364c1c90dbfbc8"
server_key_iv: "ada07985cd23da089590d968a28f2b71"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.071017 928 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:06.088487 928 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:06.091197 928 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:06.091390 928 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:06.098202 928 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36339
I20260811 04:51:06.098469 1003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36339 every 8 connection(s)
I20260811 04:51:06.099166 928 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:06.100843 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 928
I20260811 04:51:06.100994 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:51:06.101298 18161 external_mini_cluster.cc:1428] Setting key bb4da62ccdbc0fb19f1c6636baf1d1e2
I20260811 04:51:06.102217 1004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:06.108875 1004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap starting.
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:06.111340 1004 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:06.112287 1004 log.cc:824] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:06.114468 1004 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: No bootstrap required, opened a new log
I20260811 04:51:06.116226 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.102743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38924 (local address 127.17.188.126:36339)
0811 04:51:06.103164 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.103185 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.103226 (+ 41us) server_negotiation.cc:407] Connection header received
0811 04:51:06.104089 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.104112 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.104501 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.104858 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:06.105522 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.107034 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.107912 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.108594 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.108761 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.111173 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:06.111181 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:06.111200 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:06.111238 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:06.113193 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.113639 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.113645 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.113658 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.113799 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.114152 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.114154 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.114155 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.114524 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:06.114739 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.115033 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.115347 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":120,"threads_started":1}
I20260811 04:51:06.117811 1004 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:06.118068 1004 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:06.118134 1004 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Initialized, Role: FOLLOWER
I20260811 04:51:06.118618 1004 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:06.118755 1004 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:06.118803 1004 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:06.118873 1004 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:06.119704 1004 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:06.120069 1004 leader_election.cc:302] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fc3bd2382814daaa4df8b082f055f5c; no voters:
I20260811 04:51:06.120414 1004 leader_election.cc:288] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:51:06.120512 1010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:06.120795 1010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 LEADER]: Becoming Leader. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Running, Role: LEADER
I20260811 04:51:06.121129 1010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:06.121557 1004 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:06.122761 1012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fc3bd2382814daaa4df8b082f055f5c. Latest consensus state: current_term: 1 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:06.122912 1012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:06.123304 1019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:06.123274 1011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:06.124177 1011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:06.126544 1019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:06.132244 1019 catalog_manager.cc:1347] Generated new cluster ID: 87379799a41649aea6aa20a28d5a08a7
I20260811 04:51:06.132314 1019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:06.156883 1019 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:51:06.157889 1019 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:06.171054 1019 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Generated new TSK 0
I20260811 04:51:06.171836 1019 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:51:06.204669 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:06.313879 1031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:06.314121 1031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:06.314191 1031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:06.318176 1031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:06.318229 1031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:06.318336 1031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:51:06.323755 1031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:06.324769 1031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:06.325788 1031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:06.335093 1038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:06.335071 1037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:06.335086 1040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.335549 1031 server_base.cc:1034] running on GCE node
I20260811 04:51:06.335994 1031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:06.336578 1031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:06.337723 1031 hybrid_clock.cc:648] HybridClock initialized: now 1786423866337704 us; error 28 us; skew 500 ppm
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:06.340313 1031 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:51:06.341116 1031 webserver.cc:460] Webserver started at http://127.17.188.65:39145/ using document root <none> and password file <none>
I20260811 04:51:06.341786 1031 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:06.341881 1031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:06.342128 1031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:06.344161 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "436effdb6c0343adbb4f32aac6b98751"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "c931ba89b1b68160dad7050f24c2c494"
server_key_iv: "dd1c63f83fe6609abee253e09051d749"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.344733 1031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "436effdb6c0343adbb4f32aac6b98751"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "c931ba89b1b68160dad7050f24c2c494"
server_key_iv: "dd1c63f83fe6609abee253e09051d749"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.348378 1031 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.006s
I20260811 04:51:06.350921 1047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.352090 1031 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:06.352250 1031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "436effdb6c0343adbb4f32aac6b98751"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "c931ba89b1b68160dad7050f24c2c494"
server_key_iv: "dd1c63f83fe6609abee253e09051d749"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.352367 1031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:06.375831 1031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:06.378661 1031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:06.378870 1031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:06.379457 1031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:06.380277 1031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:06.380347 1031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.380415 1031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:06.380446 1031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.389205 1031 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37499
I20260811 04:51:06.389235 1171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37499 every 8 connection(s)
I20260811 04:51:06.390161 1031 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:51:06.390827 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1031
I20260811 04:51:06.390971 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:51:06.391285 18161 external_mini_cluster.cc:1428] Setting key e31b90a39b9cab4af0fd2f250ee8eebe
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:51:06.405064 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.392119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:47013 (local address 127.17.188.126:36339)
0811 04:51:06.392264 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.392268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.393386 (+ 1118us) server_negotiation.cc:407] Connection header received
0811 04:51:06.395489 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.395494 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.395556 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.395666 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:06.396841 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.397387 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.398706 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.398952 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.399067 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.401511 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:06.401515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:06.401517 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:06.401541 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:06.402952 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.403472 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.403475 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.403477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.403563 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.403942 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.403946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.403948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.404136 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:06.404256 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.404759 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.404888 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:51:06.406145 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.392636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:47013)
0811 04:51:06.393200 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.393264 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.395233 (+ 1969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.395861 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.395867 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.396220 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:06.396690 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.396704 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.397517 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.397521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.398560 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.398571 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.399107 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.399111 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.399288 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.399913 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:06.399929 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:06.401339 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:06.403082 (+ 1743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.403089 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.403112 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.403361 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.403694 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.403697 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.403699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.403840 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.404257 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:06.404265 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:06.404511 (+ 246us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.404715 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.405035 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":158,"threads_started":1}
I20260811 04:51:06.407480 1172 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:06.407733 1172 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:06.408227 1172 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:06.409942 962 ts_manager.cc:194] Registered new tserver with Master: 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:06.411723 962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:47013
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:51:06.421540 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:06.534783 1177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:06.535060 1177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:06.535105 1177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:06.539227 1177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:06.539290 1177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:06.539350 1177 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:51:06.544621 1177 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:06.545679 1177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:06.546664 1177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:06.556769 1183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:06.556758 1184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.556821 1177 server_base.cc:1034] running on GCE node
W20260811 04:51:06.556771 1186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.557453 1177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:06.558152 1177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:06.559350 1177 hybrid_clock.cc:648] HybridClock initialized: now 1786423866559333 us; error 28 us; skew 500 ppm
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:06.562235 1177 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:51:06.563130 1177 webserver.cc:460] Webserver started at http://127.17.188.66:39835/ using document root <none> and password file <none>
I20260811 04:51:06.563717 1177 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:06.563817 1177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:06.564059 1177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:06.566175 1177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "7f087306d493fec50172cdd498f65ade"
server_key_iv: "d5874c4cad20c7ef8e1ec20e45c674cb"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.566761 1177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "7f087306d493fec50172cdd498f65ade"
server_key_iv: "d5874c4cad20c7ef8e1ec20e45c674cb"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.570565 1177 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:51:06.572947 1193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.574271 1177 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:06.574404 1177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "7f087306d493fec50172cdd498f65ade"
server_key_iv: "d5874c4cad20c7ef8e1ec20e45c674cb"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.574517 1177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:06.594265 1177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:06.597304 1177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:06.597514 1177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:06.598173 1177 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:06.599045 1177 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:06.599092 1177 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.599212 1177 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:06.599252 1177 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.607932 1177 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:35713
I20260811 04:51:06.608011 1321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:35713 every 8 connection(s)
I20260811 04:51:06.608855 1177 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:06.619203 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1177
I20260811 04:51:06.619342 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:51:06.619617 18161 external_mini_cluster.cc:1428] Setting key 5522592cfeb9d4ef2b58e7feb2dc70f4
I20260811 04:51:06.624013 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.610864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:47563 (local address 127.17.188.126:36339)
0811 04:51:06.611005 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.611015 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.611903 (+ 888us) server_negotiation.cc:407] Connection header received
0811 04:51:06.613353 (+ 1450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.613357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.613416 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.613529 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:06.614797 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.615534 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.616728 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.616965 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.617081 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.619748 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:06.619752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:06.619755 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:06.619786 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:06.621604 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.622144 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.622157 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.622162 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.622260 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.622721 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.622727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.622732 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.623043 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:06.623147 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.623651 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.623810 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:51:06.625169 1324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.611248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:47563)
0811 04:51:06.611709 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.611771 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.613124 (+ 1353us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.613751 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.613758 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.614126 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:06.614627 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.614641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.615680 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.615688 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.616567 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.616578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.617130 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.617134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.617313 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.617903 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:06.617921 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:06.619542 (+ 1621us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:06.621711 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.621715 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.621727 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.622042 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.622370 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.622374 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.622376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.622605 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.623157 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:06.623162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:06.623400 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.623564 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.623989 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":115,"threads_started":1}
I20260811 04:51:06.626482 1322 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:06.626787 1322 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:06.627584 1322 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:06.628676 962 ts_manager.cc:194] Registered new tserver with Master: 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
I20260811 04:51:06.629280 962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:47563
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:51:06.649433 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:06.760151 1328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:06.760454 1328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:06.760566 1328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:06.764536 1328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:06.764613 1328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:06.764700 1328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:51:06.769762 1328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:06.770745 1328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:06.771718 1328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:06.781194 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:06.781184 1333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.781401 1328 server_base.cc:1034] running on GCE node
W20260811 04:51:06.781172 1336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:06.781874 1328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:06.782567 1328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:06.783769 1328 hybrid_clock.cc:648] HybridClock initialized: now 1786423866783755 us; error 23 us; skew 500 ppm
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:06.786587 1328 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:51:06.787364 1328 webserver.cc:460] Webserver started at http://127.17.188.67:37643/ using document root <none> and password file <none>
I20260811 04:51:06.787894 1328 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:06.787982 1328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:06.788205 1328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:06.790128 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "802eb4f5f3524bb3869cc48abc4bd3b7"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "ad157a7b722fa6867bc6209ecf65bd36"
server_key_iv: "d466575b1789f0689e68d831c777bc3a"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.790655 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "802eb4f5f3524bb3869cc48abc4bd3b7"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "ad157a7b722fa6867bc6209ecf65bd36"
server_key_iv: "d466575b1789f0689e68d831c777bc3a"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.794142 1328 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:51:06.796521 1343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.797729 1328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:06.797853 1328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "802eb4f5f3524bb3869cc48abc4bd3b7"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "ad157a7b722fa6867bc6209ecf65bd36"
server_key_iv: "d466575b1789f0689e68d831c777bc3a"
server_key_version: "encryptionkey@0"
I20260811 04:51:06.797959 1328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:06.807902 1328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:06.811000 1328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:06.811192 1328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:06.811722 1328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:06.812498 1328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:06.812569 1328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.812644 1328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:06.812696 1328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:06.821856 1328 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44197
I20260811 04:51:06.821887 1471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44197 every 8 connection(s)
I20260811 04:51:06.822881 1328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:51:06.826099 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1328
I20260811 04:51:06.826233 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:51:06.826506 18161 external_mini_cluster.cc:1428] Setting key 873f505158058cac51ec0ab4e54f971c
Aug 11 04:51:06 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423866, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:06.836369 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.824641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:46131 (local address 127.17.188.126:36339)
0811 04:51:06.824791 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.824795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.825621 (+ 826us) server_negotiation.cc:407] Connection header received
0811 04:51:06.827206 (+ 1585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.827210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.827265 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.827338 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:06.828491 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.829013 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.830250 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.830479 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.830591 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.833023 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:06.833026 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:06.833028 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:06.833053 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:06.834568 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.835048 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.835051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.835052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.835135 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.835423 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.835425 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.835426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.835599 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:06.835676 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.836131 (+ 455us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.836229 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 04:51:06.837213 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.824995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:46131)
0811 04:51:06.825452 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.825494 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.826988 (+ 1494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.827512 (+ 524us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.827521 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.827894 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:06.828353 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.828365 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.829141 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.829145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.830122 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.830132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.830635 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.830639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.830805 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.831404 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:06.831420 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:06.832864 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:06.834699 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.834703 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.834714 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.834962 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.835215 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:06.835217 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:06.835218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:06.835346 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:06.835687 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:06.835692 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:06.835928 (+ 236us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.836076 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.836344 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":120,"threads_started":1}
I20260811 04:51:06.838438 1472 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:06.838714 1472 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:06.839301 1472 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:06.840399 962 ts_manager.cc:194] Registered new tserver with Master: 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197)
I20260811 04:51:06.840960 962 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:46131
I20260811 04:51:06.851893 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:51:06.861805 1008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.853792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38940 (local address 127.17.188.126:36339)
0811 04:51:06.853915 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.853919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.854087 (+ 168us) server_negotiation.cc:407] Connection header received
0811 04:51:06.854176 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.854178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.854214 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.854278 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:06.854975 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.855460 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.856327 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.856526 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.856600 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.858074 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:06.858077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:06.858079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:06.858098 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:06.859802 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.860342 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.860348 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.860350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.860439 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:06.860776 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:06.860780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:06.860782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:06.861082 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:06.861220 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.861502 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.861646 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:51:06.864521 962 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38940:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:51:06.867501 962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:51:06.881635 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.876200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.0.0.1:45432)
0811 04:51:06.877312 (+ 1112us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.877325 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.877408 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.878000 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.878003 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.878020 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:06.878123 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.878129 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.879458 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.879461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.880347 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.880357 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.881177 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.881181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.881281 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.881304 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.881388 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.881453 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1035,"mutex_wait_us":64,"thread_start_us":99,"threads_started":1}
I20260811 04:51:06.881706 1489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.876947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45432 (local address 127.17.188.65:37499)
0811 04:51:06.877263 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.877277 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.877405 (+ 128us) server_negotiation.cc:407] Connection header received
0811 04:51:06.877505 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.877510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.877719 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.877854 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:06.878242 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.879301 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.880471 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.881049 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.881152 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.881288 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.881419 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.881517 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":114,"threads_started":1}
I20260811 04:51:06.881778 1488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.876428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37696 (local address 127.17.188.67:44197)
0811 04:51:06.876914 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.876926 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.876947 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:51:06.877017 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.877022 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.877214 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.877361 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:06.877802 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.878716 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.880223 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.880869 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.880954 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.881055 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.881529 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.881646 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":144,"threads_started":1}
I20260811 04:51:06.882205 1485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.875693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44197 (local address 127.0.0.1:37696)
0811 04:51:06.876590 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.876602 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.876692 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.877513 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.877516 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.877533 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:06.877681 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.877687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.878862 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.878865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.880086 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.880097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.880992 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.880996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.881115 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.881175 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.881279 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.881405 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"mutex_wait_us":42,"thread_start_us":108,"threads_started":1}
I20260811 04:51:06.882792 1484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.875514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.0.0.1:43116)
0811 04:51:06.876018 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:06.876065 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:06.876187 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:06.876899 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:06.876904 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:06.876926 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:06.877051 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.877058 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.878569 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.878572 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.880086 (+ 1514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:06.880097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.882369 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.882372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:06.882480 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.882536 (+ 56us) client_negotiation.cc:769] Sending connection context
0811 04:51:06.882587 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 04:51:06.882674 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"mutex_wait_us":83,"thread_start_us":77,"threads_started":1}
I20260811 04:51:06.883488 1486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:06.875699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43116 (local address 127.17.188.66:35713)
0811 04:51:06.876384 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:06.876398 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:06.876422 (+ 24us) server_negotiation.cc:407] Connection header received
0811 04:51:06.876502 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:06.876507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:06.876724 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:06.876914 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:06.877210 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.878426 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.881134 (+ 2708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:06.882229 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:06.883053 (+ 824us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:06.883200 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:06.883253 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 04:51:06.883341 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":133,"threads_started":1}
I20260811 04:51:06.885047 1102 tablet_service.cc:1467] Processing CreateTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (DEFAULT_TABLE table=test-table [id=c1562e1b4d3647ab84f41c68cec258f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:06.885100 1400 tablet_service.cc:1467] Processing CreateTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (DEFAULT_TABLE table=test-table [id=c1562e1b4d3647ab84f41c68cec258f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:06.886132 1102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ccfbc0a86d4c41a030a9a09f9dc666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:06.886150 1400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ccfbc0a86d4c41a030a9a09f9dc666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:06.886009 1248 tablet_service.cc:1467] Processing CreateTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (DEFAULT_TABLE table=test-table [id=c1562e1b4d3647ab84f41c68cec258f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:06.886849 1248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0ccfbc0a86d4c41a030a9a09f9dc666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:06.892119 1490 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Bootstrap starting.
I20260811 04:51:06.893949 1493 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Bootstrap starting.
I20260811 04:51:06.894348 1490 tablet_bootstrap.cc:654] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:06.895403 1490 log.cc:824] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:06.896102 1492 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Bootstrap starting.
I20260811 04:51:06.896219 1493 tablet_bootstrap.cc:654] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:06.897099 1493 log.cc:824] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:06.897413 1490 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: No bootstrap required, opened a new log
I20260811 04:51:06.897643 1490 ts_tablet_manager.cc:1397] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:51:06.898876 1493 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: No bootstrap required, opened a new log
I20260811 04:51:06.899061 1493 ts_tablet_manager.cc:1397] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:51:06.900525 1490 raft_consensus.cc:348] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.900810 1490 raft_consensus.cc:374] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:06.900883 1490 raft_consensus.cc:729] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436effdb6c0343adbb4f32aac6b98751, State: Initialized, Role: FOLLOWER
I20260811 04:51:06.901335 1490 consensus_queue.cc:260] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.901998 1172 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
I20260811 04:51:06.902264 1490 ts_tablet_manager.cc:1428] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20260811 04:51:06.902235 1493 raft_consensus.cc:348] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.902554 1493 raft_consensus.cc:374] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:06.902655 1493 raft_consensus.cc:729] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fd895ab8a84745a13c6ba659fe5bfa, State: Initialized, Role: FOLLOWER
I20260811 04:51:06.903146 1493 consensus_queue.cc:260] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.904083 1493 ts_tablet_manager.cc:1428] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:51:06.904474 1322 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
I20260811 04:51:06.904735 1492 tablet_bootstrap.cc:654] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:06.905520 1492 log.cc:824] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:06.907454 1492 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: No bootstrap required, opened a new log
I20260811 04:51:06.907660 1492 ts_tablet_manager.cc:1397] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260811 04:51:06.910377 1492 raft_consensus.cc:348] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.910591 1492 raft_consensus.cc:374] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:06.910671 1492 raft_consensus.cc:729] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802eb4f5f3524bb3869cc48abc4bd3b7, State: Initialized, Role: FOLLOWER
I20260811 04:51:06.911092 1492 consensus_queue.cc:260] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:06.911751 1472 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
I20260811 04:51:06.912019 1492 ts_tablet_manager.cc:1428] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20260811 04:51:07.015537 1501 raft_consensus.cc:482] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:07.015866 1501 raft_consensus.cc:504] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.017030 1501 leader_election.cc:288] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713), 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:07.021857 1489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.017784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:44283 (local address 127.17.188.65:37499)
0811 04:51:07.017937 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.017942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.018153 (+ 211us) server_negotiation.cc:407] Connection header received
0811 04:51:07.018275 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.018281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.018330 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.018406 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:07.018659 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.019320 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.020666 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.021254 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.021357 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.021401 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.021641 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.021718 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 04:51:07.021857 1486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.017413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:41967 (local address 127.17.188.66:35713)
0811 04:51:07.017598 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.017603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.017621 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:51:07.017786 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.017792 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.017863 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.017948 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:07.018316 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.019082 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.020552 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.021172 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.021308 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.021389 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.021641 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.021718 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:51:07.021884 1474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.017335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.17.188.67:41967)
0811 04:51:07.017496 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.017514 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.017644 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.018011 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.018014 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.018034 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:07.018199 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.018209 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.019207 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.019209 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.020430 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.020441 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.021286 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.021289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.021424 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.021494 (+ 70us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.021612 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.021728 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50,"mutex_wait_us":39}
I20260811 04:51:07.021893 1502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.017687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.17.188.67:44283)
0811 04:51:07.018056 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.018068 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.018163 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.018429 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.018431 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.018446 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:07.018537 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.018542 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.019420 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.019423 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.020551 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.020559 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.021354 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.021357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.021464 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.021509 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.021636 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.021729 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":43,"thread_start_us":149,"threads_started":1}
I20260811 04:51:07.022605 1269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ccfbc0a86d4c41a030a9a09f9dc666" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" is_pre_election: true
I20260811 04:51:07.022639 1123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ccfbc0a86d4c41a030a9a09f9dc666" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436effdb6c0343adbb4f32aac6b98751" is_pre_election: true
I20260811 04:51:07.022955 1269 raft_consensus.cc:2454] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 0.
I20260811 04:51:07.022961 1123 raft_consensus.cc:2454] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 0.
I20260811 04:51:07.023456 1344 leader_election.cc:302] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751, 802eb4f5f3524bb3869cc48abc4bd3b7; no voters:
I20260811 04:51:07.023733 1501 raft_consensus.cc:2781] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:51:07.023837 1501 raft_consensus.cc:482] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:51:07.023893 1501 raft_consensus.cc:3037] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:07.024927 1501 raft_consensus.cc:504] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.025260 1501 leader_election.cc:288] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 election: Requested vote from peers 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713), 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:07.025630 1269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ccfbc0a86d4c41a030a9a09f9dc666" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
I20260811 04:51:07.025729 1123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ccfbc0a86d4c41a030a9a09f9dc666" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436effdb6c0343adbb4f32aac6b98751"
I20260811 04:51:07.025756 1269 raft_consensus.cc:3037] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:07.025851 1123 raft_consensus.cc:3037] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:07.027102 1123 raft_consensus.cc:2454] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 1.
I20260811 04:51:07.027102 1269 raft_consensus.cc:2454] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 1.
I20260811 04:51:07.027369 1344 leader_election.cc:302] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751, 802eb4f5f3524bb3869cc48abc4bd3b7; no voters:
I20260811 04:51:07.027535 1501 raft_consensus.cc:2781] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:07.027782 1501 raft_consensus.cc:686] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 LEADER]: Becoming Leader. State: Replica: 802eb4f5f3524bb3869cc48abc4bd3b7, State: Running, Role: LEADER
I20260811 04:51:07.028106 1501 consensus_queue.cc:237] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.031306 961 catalog_manager.cc:5495] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260811 04:51:07.069195 1488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.065248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37698 (local address 127.17.188.67:44197)
0811 04:51:07.065398 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.065403 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.065420 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:51:07.065514 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.065517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.065634 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.065815 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:07.066213 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.067004 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.067819 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.068027 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.068101 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.068369 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:07.068787 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:51:07.068878 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.068940 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.068988 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 04:51:07.074062 1473 tablet.cc:2369] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:51:07.079232 1123 raft_consensus.cc:1261] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Refusing update from remote peer 802eb4f5f3524bb3869cc48abc4bd3b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:07.079254 1269 raft_consensus.cc:1261] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Refusing update from remote peer 802eb4f5f3524bb3869cc48abc4bd3b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:07.080034 1501 consensus_queue.cc:1035] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:07.080251 1503 consensus_queue.cc:1035] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:07.087553 1506 mvcc.cc:205] Tried to move back new op lower bound from 7317192159545016320 to 7317192159349682176. Current Snapshot: MvccSnapshot[applied={T|T < 7317192159545016320}]
I20260811 04:51:07.092555 1508 mvcc.cc:205] Tried to move back new op lower bound from 7317192159545016320 to 7317192159349682176. Current Snapshot: MvccSnapshot[applied={T|T < 7317192159545016320 or (T in {7317192159545016320})}]
I20260811 04:51:07.092809 1507 mvcc.cc:205] Tried to move back new op lower bound from 7317192159545016320 to 7317192159349682176. Current Snapshot: MvccSnapshot[applied={T|T < 7317192159545016320}]
I20260811 04:51:07.098716 959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:07.098923 959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38940:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:07.101763 959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Sending DeleteTablet for 3 replicas of tablet c0ccfbc0a86d4c41a030a9a09f9dc666
I20260811 04:51:07.102744 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1031
I20260811 04:51:07.106002 1248 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:07 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:43116
I20260811 04:51:07.114117 1400 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:07 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:37696
I20260811 04:51:07.114670 1516 tablet_replica.cc:330] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: stopping tablet replica
I20260811 04:51:07.115022 1516 raft_consensus.cc:2229] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:51:07.115422 1516 raft_consensus.cc:2258] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:07.116833 1516 ts_tablet_manager.cc:1905] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:07.117962 1515 tablet_replica.cc:330] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: stopping tablet replica
I20260811 04:51:07.118391 1515 raft_consensus.cc:2229] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:07.118831 1515 raft_consensus.cc:2258] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:07.119983 1516 ts_tablet_manager.cc:1918] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:07.120172 1516 log.cc:1196] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/c0ccfbc0a86d4c41a030a9a09f9dc666
I20260811 04:51:07.120633 1516 ts_tablet_manager.cc:1939] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting consensus metadata
W20260811 04:51:07.120949 944 connection.cc:535] client connection to 127.17.188.65:37499 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 04:51:07.121104 944 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:51:07.121874 946 catalog_manager.cc:4841] TS 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (table test-table [id=c1562e1b4d3647ab84f41c68cec258f3]) successfully deleted
I20260811 04:51:07.121937 1515 ts_tablet_manager.cc:1905] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:07.122013 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1177
I20260811 04:51:07.130605 1485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.130247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.0.0.1:45448)
0811 04:51:07.130440 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.130512 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
W20260811 04:51:07.130863 944 catalog_manager.cc:4584] TS 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c0ccfbc0a86d4c41a030a9a09f9dc666: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37499: connect: Connection refused (error 111)
I20260811 04:51:07.135105 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1328
I20260811 04:51:07.142629 1485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.135193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.0.0.1:43118)
0811 04:51:07.142515 (+ 7322us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.142566 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.66:35713: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7243}
I20260811 04:51:07.147119 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 928
I20260811 04:51:07.155195 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--webserver_interface=127.17.188.126
--webserver_port=33893
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:07.264598 1518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:07.264851 1518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:07.264889 1518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:07.268864 1518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:07.268920 1518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:07.268939 1518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:07.268972 1518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:07.268987 1518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:07.274144 1518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=33893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:07.275184 1518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:07.276188 1518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:07.289830 1526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.290046 1518 server_base.cc:1034] running on GCE node
W20260811 04:51:07.289830 1525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.289860 1528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.290850 1518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:07.292032 1518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:07.293219 1518 hybrid_clock.cc:648] HybridClock initialized: now 1786423867293202 us; error 32 us; skew 500 ppm
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:07.296119 1518 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:07.297039 1518 webserver.cc:460] Webserver started at http://127.17.188.126:33893/ using document root <none> and password file <none>
I20260811 04:51:07.297694 1518 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:07.297804 1518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:07.301645 1518 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 04:51:07.303745 1535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.304955 1518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:07.305095 1518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "4fc3bd2382814daaa4df8b082f055f5c"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "91678c06e796259bb5364c1c90dbfbc8"
server_key_iv: "ada07985cd23da089590d968a28f2b71"
server_key_version: "encryptionkey@0"
I20260811 04:51:07.305740 1518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:07.322999 1518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:07.325569 1518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:07.325821 1518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:07.332962 1518 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36339
I20260811 04:51:07.333249 1591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36339 every 8 connection(s)
I20260811 04:51:07.334152 1518 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:07.338186 1592 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:51:07.339733 1592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap starting.
I20260811 04:51:07.342432 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1518
I20260811 04:51:07.342921 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:37499
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=39145
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:07.358060 1592 log.cc:824] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:07.366765 1592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:07.367168 1592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap complete.
I20260811 04:51:07.371366 1592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:07.371779 1592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.372249 1592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:07.372396 1592 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:07.372489 1592 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:07.372618 1592 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:51:07.374532 1592 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:07.374886 1592 leader_election.cc:302] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fc3bd2382814daaa4df8b082f055f5c; no voters:
I20260811 04:51:07.375223 1592 leader_election.cc:288] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 04:51:07.375306 1596 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 04:51:07.375511 1596 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 LEADER]: Becoming Leader. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Running, Role: LEADER
I20260811 04:51:07.375896 1596 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:07.376479 1592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:07.377532 1598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:07.377579 1599 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fc3bd2382814daaa4df8b082f055f5c. Latest consensus state: current_term: 2 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:07.377686 1598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:07.377686 1599 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:07.378986 1603 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:07.383771 1603 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:07.384359 1603 catalog_manager.cc:1259] Loaded cluster ID: 87379799a41649aea6aa20a28d5a08a7
I20260811 04:51:07.384420 1603 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:07.385854 1603 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 04:51:07.390287 1603 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 04:51:07.395630 1603 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:07.396296 1603 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Loaded TSK: 0
I20260811 04:51:07.397424 1603 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:51:07.464030 1594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:07.464282 1594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:07.464324 1594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:07.468497 1594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:07.468564 1594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:07.468621 1594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:51:07.473930 1594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:37499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=39145
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:07.474985 1594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:07.476008 1594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:51:07.486944 1594 server_base.cc:1034] running on GCE node
W20260811 04:51:07.487035 1623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.486907 1624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.486846 1626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.487632 1594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:07.488250 1594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:07.489434 1594 hybrid_clock.cc:648] HybridClock initialized: now 1786423867489407 us; error 46 us; skew 500 ppm
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:07.492348 1594 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:51:07.493299 1594 webserver.cc:460] Webserver started at http://127.17.188.65:39145/ using document root <none> and password file <none>
I20260811 04:51:07.493919 1594 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:07.494026 1594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:07.497917 1594 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:51:07.499977 1634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.501201 1594 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:07.501288 1594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "436effdb6c0343adbb4f32aac6b98751"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "c931ba89b1b68160dad7050f24c2c494"
server_key_iv: "dd1c63f83fe6609abee253e09051d749"
server_key_version: "encryptionkey@0"
I20260811 04:51:07.501899 1594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:07.521070 1594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:07.524087 1594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:07.524314 1594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:07.524955 1594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:07.526234 1642 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 04:51:07.530448 1594 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 04:51:07.530537 1594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260811 04:51:07.530617 1594 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 04:51:07.532272 1594 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 04:51:07.532320 1594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 04:51:07.532604 1642 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Bootstrap starting.
I20260811 04:51:07.543303 1594 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37499
I20260811 04:51:07.543349 1758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37499 every 8 connection(s)
I20260811 04:51:07.544361 1594 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:51:07.550978 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1594
I20260811 04:51:07.551432 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:35713
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=39835
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:07.552524 1642 log.cc:824] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Log is configured to *not* fsync() on all Append() calls
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:07.562294 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.546631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:37815 (local address 127.17.188.126:36339)
0811 04:51:07.547037 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.547056 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.547529 (+ 473us) server_negotiation.cc:407] Connection header received
0811 04:51:07.548621 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.548656 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.549094 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.549467 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.550574 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.552081 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.553758 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.554559 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.554753 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.557284 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.557289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.557301 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.557330 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.559054 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.559581 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.559587 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.559590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.559710 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.560044 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.560049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.560050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.560414 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.560570 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.561104 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.561364 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":124,"threads_started":1}
I20260811 04:51:07.562309 1764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.546600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:37815)
0811 04:51:07.547326 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.547377 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.548142 (+ 765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.549503 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.549509 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.549937 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:07.550392 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.550405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.552267 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.552271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.553595 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.553606 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.554728 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.554732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.554918 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.555603 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:07.555620 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:07.557073 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:07.559182 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.559188 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.559201 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.559458 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.559810 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.559813 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.559815 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.559951 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.560541 (+ 590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:07.560547 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:07.560801 (+ 254us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.560991 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.561347 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":141,"threads_started":1}
I20260811 04:51:07.562968 1642 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:07.563508 1642 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Bootstrap complete.
I20260811 04:51:07.564894 1759 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:07.565244 1642 ts_tablet_manager.cc:1397] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.004s
I20260811 04:51:07.565373 1759 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:07.565927 1759 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:07.568166 1555 ts_manager.cc:194] Registered new tserver with Master: 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:07.568485 1642 raft_consensus.cc:348] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.569036 1642 raft_consensus.cc:729] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436effdb6c0343adbb4f32aac6b98751, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.569948 1642 consensus_queue.cc:260] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.570937 1642 ts_tablet_manager.cc:1428] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:51:07.571780 1555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:37815
I20260811 04:51:07.574635 1759 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:51:07.582333 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.571834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.17.188.65:37499)
0811 04:51:07.572142 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.572153 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.572175 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:51:07.572238 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.572243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.572429 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.572616 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.573370 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.574165 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.575200 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.575720 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.575850 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.578693 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.578702 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.578713 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.578736 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.580388 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.580936 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.580941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.580942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.581015 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.581287 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.581289 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.581291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.581502 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.581694 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.582083 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.582214 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":117,"threads_started":1}
I20260811 04:51:07.582372 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.571105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.0.0.1:45460)
0811 04:51:07.571492 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.571541 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.571684 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.572785 (+ 1101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.572791 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.573144 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:07.573246 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.573252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.574281 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.574286 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.575072 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.575085 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.575891 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.575896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.576044 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.576608 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:07.576623 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:07.578533 (+ 1910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:07.580499 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.580508 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.580514 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.580825 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.581103 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.581108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.581111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.581202 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.581670 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:07.581692 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:07.581863 (+ 171us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.582013 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.582203 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":89,"threads_started":1}
I20260811 04:51:07.583468 1688 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:07 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:45460
I20260811 04:51:07.584291 1771 tablet_replica.cc:330] stopping tablet replica
I20260811 04:51:07.584578 1771 raft_consensus.cc:2229] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:07.584822 1771 raft_consensus.cc:2258] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:07.585784 1771 ts_tablet_manager.cc:1905] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:07.589155 1771 ts_tablet_manager.cc:1918] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:07.589236 1771 log.cc:1196] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/c0ccfbc0a86d4c41a030a9a09f9dc666
I20260811 04:51:07.589538 1771 ts_tablet_manager.cc:1939] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 436effdb6c0343adbb4f32aac6b98751: Deleting consensus metadata
I20260811 04:51:07.591068 1536 catalog_manager.cc:4841] TS 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499): tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (table test-table [id=c1562e1b4d3647ab84f41c68cec258f3]) successfully deleted
W20260811 04:51:07.674168 1766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:07.674512 1766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:07.674608 1766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:07.678860 1766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:07.678933 1766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:07.679014 1766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:51:07.684121 1766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:35713
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=39835
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:07.685133 1766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:07.686180 1766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:07.695890 1776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.696025 1766 server_base.cc:1034] running on GCE node
W20260811 04:51:07.695884 1777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.695884 1779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.696640 1766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:07.697206 1766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:07.698360 1766 hybrid_clock.cc:648] HybridClock initialized: now 1786423867698330 us; error 41 us; skew 500 ppm
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:07.701018 1766 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:51:07.701902 1766 webserver.cc:460] Webserver started at http://127.17.188.66:39835/ using document root <none> and password file <none>
I20260811 04:51:07.702471 1766 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:07.702571 1766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:07.706697 1766 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:51:07.708895 1786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.710243 1766 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:07.710361 1766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "7f087306d493fec50172cdd498f65ade"
server_key_iv: "d5874c4cad20c7ef8e1ec20e45c674cb"
server_key_version: "encryptionkey@0"
I20260811 04:51:07.710886 1766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:07.723842 1766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:07.727133 1766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:07.727346 1766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:07.727962 1766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:07.729058 1796 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 04:51:07.733189 1766 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 04:51:07.733268 1766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260811 04:51:07.733374 1766 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 04:51:07.735234 1766 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 04:51:07.735303 1766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 04:51:07.735558 1796 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Bootstrap starting.
I20260811 04:51:07.741241 1796 log.cc:824] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:07.745816 1766 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:35713
I20260811 04:51:07.745880 1916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:35713 every 8 connection(s)
I20260811 04:51:07.746632 1766 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:51:07.748924 1796 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:07.749351 1796 tablet_bootstrap.cc:492] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Bootstrap complete.
I20260811 04:51:07.749727 1796 ts_tablet_manager.cc:1397] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.004s
I20260811 04:51:07.750412 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1766
I20260811 04:51:07.750874 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:44197
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=37643
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:07.752918 1796 raft_consensus.cc:348] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.753539 1796 raft_consensus.cc:729] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fd895ab8a84745a13c6ba659fe5bfa, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.754103 1796 consensus_queue.cc:260] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.755188 1796 ts_tablet_manager.cc:1428] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:07.761545 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.748403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:52653 (local address 127.17.188.126:36339)
0811 04:51:07.748561 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.748568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.749216 (+ 648us) server_negotiation.cc:407] Connection header received
0811 04:51:07.750432 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.750437 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.750507 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.750600 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.752081 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.752954 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.754259 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.754644 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.754762 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.757912 (+ 3150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.757916 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.757919 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.757950 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.759400 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.760038 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.760042 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.760043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.760127 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.760500 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.760503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.760505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.760683 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.760787 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.761244 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.761377 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:51:07.762301 1919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.748521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:52653)
0811 04:51:07.749039 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.749104 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.750195 (+ 1091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.750753 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.750761 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.751243 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:07.751898 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.751916 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.753079 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.753082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.754130 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.754140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.754763 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.754766 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.754946 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.755984 (+ 1038us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:07.756000 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:07.757744 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:07.759621 (+ 1877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.759628 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.759641 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.759903 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.760227 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.760247 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.760249 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.760397 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.760788 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:07.760795 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:07.761015 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.761187 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.761485 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":129,"threads_started":1}
I20260811 04:51:07.763447 1917 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:07.763690 1917 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:07.764146 1917 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:07.765715 1555 ts_manager.cc:194] Registered new tserver with Master: 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
I20260811 04:51:07.767004 1555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:52653
I20260811 04:51:07.768981 1917 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.66@KRBTEST.COM
I20260811 04:51:07.776926 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.766783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.0.0.1:43120)
0811 04:51:07.767011 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.767026 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.767102 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.767834 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.767837 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.768019 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:07.768114 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.768120 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.769687 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.769691 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.770577 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.770586 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.771328 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.771330 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.771395 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.771851 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:07.771862 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:07.773227 (+ 1365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:07.775348 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.775350 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.775352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.775541 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.775847 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.775849 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.775850 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.775920 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.776418 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:07.776420 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:07.776494 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.776653 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.776805 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260811 04:51:07.777034 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.766863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43120 (local address 127.17.188.66:35713)
0811 04:51:07.767384 (+ 521us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.767400 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.767423 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:51:07.767485 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.767490 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.767684 (+ 194us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.767820 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.768421 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.769533 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.770685 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.771223 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.771326 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.773366 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.773375 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.773388 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.773416 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.775228 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.775645 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.775651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.775652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.775757 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.776006 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.776011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.776014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.776279 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.776442 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.776741 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.776875 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":121,"threads_started":1}
I20260811 04:51:07.777989 1841 tablet_service.cc:1514] Processing DeleteTablet for tablet c0ccfbc0a86d4c41a030a9a09f9dc666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:07 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:43120
I20260811 04:51:07.778872 1923 tablet_replica.cc:330] stopping tablet replica
I20260811 04:51:07.779150 1923 raft_consensus.cc:2229] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:07.779349 1923 raft_consensus.cc:2258] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:07.780200 1923 ts_tablet_manager.cc:1905] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:07.783757 1923 ts_tablet_manager.cc:1918] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:07.783838 1923 log.cc:1196] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/c0ccfbc0a86d4c41a030a9a09f9dc666
I20260811 04:51:07.784148 1923 ts_tablet_manager.cc:1939] T c0ccfbc0a86d4c41a030a9a09f9dc666 P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting consensus metadata
I20260811 04:51:07.785485 1536 catalog_manager.cc:4841] TS 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): tablet c0ccfbc0a86d4c41a030a9a09f9dc666 (table test-table [id=c1562e1b4d3647ab84f41c68cec258f3]) successfully deleted
W20260811 04:51:07.867738 1920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:07.867975 1920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:07.868053 1920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:07.872008 1920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:07.872061 1920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:07.872136 1920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:51:07.877300 1920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:44197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=37643
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:07.878441 1920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:07.879515 1920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:07.889147 1928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.889147 1932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:07.889189 1929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:07.889359 1920 server_base.cc:1034] running on GCE node
I20260811 04:51:07.889892 1920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:07.890475 1920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:07.891674 1920 hybrid_clock.cc:648] HybridClock initialized: now 1786423867891633 us; error 49 us; skew 500 ppm
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:07.894767 1920 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:51:07.895581 1920 webserver.cc:460] Webserver started at http://127.17.188.67:37643/ using document root <none> and password file <none>
I20260811 04:51:07.896157 1920 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:07.896260 1920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:07.900029 1920 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 04:51:07.901887 1939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.903144 1920 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:07.903236 1920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "802eb4f5f3524bb3869cc48abc4bd3b7"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "ad157a7b722fa6867bc6209ecf65bd36"
server_key_iv: "d466575b1789f0689e68d831c777bc3a"
server_key_version: "encryptionkey@0"
I20260811 04:51:07.903795 1920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:07.916628 1920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:07.919601 1920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:07.919821 1920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:07.920377 1920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:07.921164 1920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:07.921211 1920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.921273 1920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:07.921311 1920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:07.930060 1920 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44197
I20260811 04:51:07.930126 2067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44197 every 8 connection(s)
I20260811 04:51:07.931039 1920 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:51:07.939440 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 1920
Aug 11 04:51:07 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423867, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:07.945493 1763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.932848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:51699 (local address 127.17.188.126:36339)
0811 04:51:07.932994 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.932998 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.933824 (+ 826us) server_negotiation.cc:407] Connection header received
0811 04:51:07.935265 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.935268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.935331 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.935442 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.936603 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.937146 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.938337 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.938591 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.938707 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.941676 (+ 2969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.941679 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.941681 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.941711 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.943183 (+ 1472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.943739 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.943741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.943743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.943813 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.944213 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.944216 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.944217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.944383 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.944480 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.945139 (+ 659us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.945267 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:51:07.946369 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.933179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:51699)
0811 04:51:07.933673 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.933714 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.935013 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.935627 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.935633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.935976 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:07.936441 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.936454 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.937275 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.937279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.938208 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.938217 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.938746 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.938751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.938917 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.939549 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:07.939574 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:07.941453 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:07.943303 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.943312 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.943328 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.943625 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.943921 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:07.943927 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:07.943931 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:07.944121 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:07.944522 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:07.944531 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:07.944856 (+ 325us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.945089 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.945355 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":115,"threads_started":1}
I20260811 04:51:07.947609 2068 heartbeater.cc:347] Connected to a master server at 127.17.188.126:36339
I20260811 04:51:07.947849 2068 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:07.948315 2068 heartbeater.cc:511] Master 127.17.188.126:36339 requested a full tablet report, sending...
I20260811 04:51:07.948668 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.940168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.17.188.126:36339)
0811 04:51:07.940453 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.940457 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.940560 (+ 103us) server_negotiation.cc:407] Connection header received
0811 04:51:07.940646 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.940649 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.940705 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.940796 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:07.941666 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.942431 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.943329 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.943545 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.943612 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.945118 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:07.945121 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:07.945124 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:07.945144 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:07.946869 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.947360 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.947363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.947364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.947439 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:07.947757 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:07.947760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:07.947762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:07.947971 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:07.948171 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.948367 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.948494 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":101,"threads_started":1}
I20260811 04:51:07.949641 1555 ts_manager.cc:194] Registered new tserver with Master: 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197)
I20260811 04:51:07.950371 1555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:51699
I20260811 04:51:07.950565 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:51:07.955282 2073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.951218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.17.188.126:36339)
0811 04:51:07.951331 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.951335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.951597 (+ 262us) server_negotiation.cc:407] Connection header received
0811 04:51:07.951749 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.951751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.951830 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.951912 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:07.952382 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.952919 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.953890 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.954101 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.954183 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.954558 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:07.954911 (+ 353us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:51:07.955006 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.955076 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.955126 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 04:51:07.955888 1555 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:38954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:51:07.959071 1555 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:51:07.966379 1688 tablet_service.cc:1467] Processing CreateTablet for tablet 3b34cec6e3794763a444f69db2e7e79d (DEFAULT_TABLE table=test-table [id=9d56b40527ea46a29d01f45110945207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:07.966379 1841 tablet_service.cc:1467] Processing CreateTablet for tablet 3b34cec6e3794763a444f69db2e7e79d (DEFAULT_TABLE table=test-table [id=9d56b40527ea46a29d01f45110945207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:07.966990 1841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b34cec6e3794763a444f69db2e7e79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:07.966990 1688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b34cec6e3794763a444f69db2e7e79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:07.969838 1642 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Bootstrap starting.
I20260811 04:51:07.970057 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.965609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44197 (local address 127.0.0.1:37706)
0811 04:51:07.965762 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:07.965778 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:07.965842 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:07.966519 (+ 677us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:07.966521 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:07.966541 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:07.966636 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.966642 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.967741 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.967746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.968763 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:07.968773 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.969604 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.969615 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:07.969699 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.969740 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 04:51:07.969833 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 04:51:07.969921 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260811 04:51:07.970511 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:07.965767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37706 (local address 127.17.188.67:44197)
0811 04:51:07.966100 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:07.966120 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:07.966146 (+ 26us) server_negotiation.cc:407] Connection header received
0811 04:51:07.966219 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:07.966223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:07.966382 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:07.966662 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:07.966842 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.967606 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.968894 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:07.969449 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:07.969570 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:07.969733 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:07.970274 (+ 541us) server_negotiation.cc:299] Negotiation successful
0811 04:51:07.970368 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":154,"threads_started":1}
I20260811 04:51:07.970671 1642 tablet_bootstrap.cc:654] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:07.971673 1796 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Bootstrap starting.
I20260811 04:51:07.972211 1642 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: No bootstrap required, opened a new log
I20260811 04:51:07.972294 1642 ts_tablet_manager.cc:1397] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:51:07.972692 1796 tablet_bootstrap.cc:654] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:07.972831 1642 raft_consensus.cc:348] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.972973 1642 raft_consensus.cc:374] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:07.973030 1642 raft_consensus.cc:729] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436effdb6c0343adbb4f32aac6b98751, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.973170 1642 consensus_queue.cc:260] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.974006 1642 ts_tablet_manager.cc:1428] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:07.974344 1796 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: No bootstrap required, opened a new log
I20260811 04:51:07.974416 1796 ts_tablet_manager.cc:1397] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 04:51:07.974807 1796 raft_consensus.cc:348] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.974500 1994 tablet_service.cc:1467] Processing CreateTablet for tablet 3b34cec6e3794763a444f69db2e7e79d (DEFAULT_TABLE table=test-table [id=9d56b40527ea46a29d01f45110945207]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:07.974926 1796 raft_consensus.cc:374] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:07.974978 1796 raft_consensus.cc:729] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61fd895ab8a84745a13c6ba659fe5bfa, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.975131 1796 consensus_queue.cc:260] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.975426 1796 ts_tablet_manager.cc:1428] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 04:51:07.975550 1994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b34cec6e3794763a444f69db2e7e79d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:07.983033 2081 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Bootstrap starting.
I20260811 04:51:07.984835 2081 tablet_bootstrap.cc:654] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:07.985868 2081 log.cc:824] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:07.987608 2081 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: No bootstrap required, opened a new log
I20260811 04:51:07.987816 2081 ts_tablet_manager.cc:1397] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 04:51:07.990293 2081 raft_consensus.cc:348] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.990479 2081 raft_consensus.cc:374] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:07.990546 2081 raft_consensus.cc:729] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 802eb4f5f3524bb3869cc48abc4bd3b7, State: Initialized, Role: FOLLOWER
I20260811 04:51:07.990918 2081 consensus_queue.cc:260] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:07.991485 2068 heartbeater.cc:503] Master 127.17.188.126:36339 was elected leader, sending a full tablet report...
I20260811 04:51:07.991803 2081 ts_tablet_manager.cc:1428] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260811 04:51:07.997526 1918 tablet.cc:2369] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:51:08.045598 1762 tablet.cc:2369] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:51:08.125438 2083 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:08.125710 2083 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:08.126909 2083 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713), 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:08.131716 1922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.127388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:34015 (local address 127.17.188.66:35713)
0811 04:51:08.127547 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:08.127552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:08.127570 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:51:08.127669 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:08.127674 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:08.127759 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:08.127873 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:08.128210 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.129003 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.130538 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.131177 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.131301 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:08.131461 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:08.131503 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 04:51:08.131571 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:51:08.131733 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.127254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.17.188.67:34015)
0811 04:51:08.127426 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.127444 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:08.127554 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:08.127908 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:08.127911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:08.127932 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:08.128079 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:08.128090 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.129116 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.129118 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:08.130418 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:08.130430 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.131297 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.131299 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:08.131380 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:08.131399 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 04:51:08.131484 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 04:51:08.131559 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":1}
I20260811 04:51:08.131927 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.127674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:49483 (local address 127.17.188.65:37499)
0811 04:51:08.127983 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:08.127988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:08.128010 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:51:08.128133 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:08.128136 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:08.128225 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:08.128336 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:08.128577 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.129259 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.130721 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.131369 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.131483 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:08.131604 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:08.131706 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 04:51:08.131793 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":105,"threads_started":1}
I20260811 04:51:08.132083 2084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.127536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.17.188.67:49483)
0811 04:51:08.127940 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.127952 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:08.128030 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:08.128357 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:08.128359 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:08.128376 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:08.128467 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:08.128471 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.129372 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.129375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:08.130603 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:08.130610 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.131490 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.131493 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:08.131583 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:08.131603 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 04:51:08.131677 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:51:08.131732 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":32,"thread_start_us":156,"threads_started":1}
I20260811 04:51:08.132398 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b34cec6e3794763a444f69db2e7e79d" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" is_pre_election: true
I20260811 04:51:08.132654 1863 raft_consensus.cc:2454] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 0.
I20260811 04:51:08.133070 1711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b34cec6e3794763a444f69db2e7e79d" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436effdb6c0343adbb4f32aac6b98751" is_pre_election: true
I20260811 04:51:08.133162 1940 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7; no voters:
I20260811 04:51:08.133344 1711 raft_consensus.cc:2454] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 0.
I20260811 04:51:08.133446 2083 raft_consensus.cc:2781] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:51:08.133539 2083 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:51:08.133634 2083 raft_consensus.cc:3037] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:08.134734 2083 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:08.135069 2083 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 election: Requested vote from peers 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713), 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499)
I20260811 04:51:08.135413 1863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b34cec6e3794763a444f69db2e7e79d" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
I20260811 04:51:08.135502 1711 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b34cec6e3794763a444f69db2e7e79d" candidate_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "436effdb6c0343adbb4f32aac6b98751"
I20260811 04:51:08.135586 1863 raft_consensus.cc:3037] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:08.135628 1711 raft_consensus.cc:3037] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:08.136612 1711 raft_consensus.cc:2454] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 1.
I20260811 04:51:08.136650 1863 raft_consensus.cc:2454] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 802eb4f5f3524bb3869cc48abc4bd3b7 in term 1.
I20260811 04:51:08.136911 1940 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751, 802eb4f5f3524bb3869cc48abc4bd3b7; no voters:
I20260811 04:51:08.137066 2083 raft_consensus.cc:2781] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:08.137311 2083 raft_consensus.cc:686] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 LEADER]: Becoming Leader. State: Replica: 802eb4f5f3524bb3869cc48abc4bd3b7, State: Running, Role: LEADER
I20260811 04:51:08.137642 2083 consensus_queue.cc:237] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:08.140856 1554 catalog_manager.cc:5495] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } health_report { overall_health: UNKNOWN } } }
I20260811 04:51:08.164220 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.160901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37716 (local address 127.17.188.67:44197)
0811 04:51:08.161040 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:08.161043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:08.161057 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:51:08.161198 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:08.161201 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:08.161255 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:08.161339 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:08.161543 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.162049 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.162842 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:08.163053 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:08.163136 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:08.163402 (+ 266us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:08.163799 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:51:08.163889 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:08.163944 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 04:51:08.163993 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:51:08.170513 1863 raft_consensus.cc:1261] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Refusing update from remote peer 802eb4f5f3524bb3869cc48abc4bd3b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:08.170534 1711 raft_consensus.cc:1261] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Refusing update from remote peer 802eb4f5f3524bb3869cc48abc4bd3b7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:08.171236 2086 consensus_queue.cc:1035] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:08.171419 2083 consensus_queue.cc:1035] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:08.178197 2093 mvcc.cc:205] Tried to move back new op lower bound from 7317192164018749440 to 7317192163894214656. Current Snapshot: MvccSnapshot[applied={T|T < 7317192164018749440}]
I20260811 04:51:08.180222 2091 mvcc.cc:205] Tried to move back new op lower bound from 7317192164018749440 to 7317192163894214656. Current Snapshot: MvccSnapshot[applied={T|T < 7317192164018749440}]
I20260811 04:51:08.185626 1555 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:38954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:08.185776 1555 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:38954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:08.187922 1555 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Sending DeleteTablet for 3 replicas of tablet 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:08.188678 1688 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b34cec6e3794763a444f69db2e7e79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:08 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:45460
I20260811 04:51:08.188661 1994 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b34cec6e3794763a444f69db2e7e79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:08 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:37706
I20260811 04:51:08.189019 2101 tablet_replica.cc:330] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: stopping tablet replica
I20260811 04:51:08.188997 1841 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b34cec6e3794763a444f69db2e7e79d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:08 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:43120
I20260811 04:51:08.189175 1923 tablet_replica.cc:330] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: stopping tablet replica
I20260811 04:51:08.189203 2102 tablet_replica.cc:330] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: stopping tablet replica
I20260811 04:51:08.189291 1923 raft_consensus.cc:2229] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:08.189245 2101 raft_consensus.cc:2229] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:08.189419 1923 raft_consensus.cc:2258] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:08.189499 2102 raft_consensus.cc:2229] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:51:08.189517 2101 raft_consensus.cc:2258] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:08.190038 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1594
I20260811 04:51:08.190053 2102 raft_consensus.cc:2258] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:08.193178 2102 ts_tablet_manager.cc:1905] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:08.194801 1923 ts_tablet_manager.cc:1905] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:08.196138 2102 ts_tablet_manager.cc:1918] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:08.196244 2102 log.cc:1196] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:08.196705 2102 ts_tablet_manager.cc:1939] T 3b34cec6e3794763a444f69db2e7e79d P 802eb4f5f3524bb3869cc48abc4bd3b7: Deleting consensus metadata
I20260811 04:51:08.197472 1923 ts_tablet_manager.cc:1918] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:08.197553 1923 log.cc:1196] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:08.197798 1923 ts_tablet_manager.cc:1939] T 3b34cec6e3794763a444f69db2e7e79d P 61fd895ab8a84745a13c6ba659fe5bfa: Deleting consensus metadata
I20260811 04:51:08.198140 1538 catalog_manager.cc:4841] TS 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): tablet 3b34cec6e3794763a444f69db2e7e79d (table test-table [id=9d56b40527ea46a29d01f45110945207]) successfully deleted
I20260811 04:51:08.198407 1536 catalog_manager.cc:4841] TS 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): tablet 3b34cec6e3794763a444f69db2e7e79d (table test-table [id=9d56b40527ea46a29d01f45110945207]) successfully deleted
W20260811 04:51:08.208992 1536 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:37499 (error 108)
I20260811 04:51:08.209028 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1766
I20260811 04:51:08.214301 1769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.213970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37499 (local address 127.0.0.1:45466)
0811 04:51:08.214122 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.214204 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 04:51:08.214685 1536 catalog_manager.cc:4584] TS 436effdb6c0343adbb4f32aac6b98751 (127.17.188.65:37499): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3b34cec6e3794763a444f69db2e7e79d: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37499: connect: Connection refused (error 111)
I20260811 04:51:08.217398 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1920
I20260811 04:51:08.225466 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 1518
I20260811 04:51:08.233897 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--webserver_interface=127.17.188.126
--webserver_port=33893
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:08.342118 2104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:08.342370 2104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:08.342408 2104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:08.346273 2104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:08.346328 2104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:08.346346 2104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:08.346364 2104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:08.346377 2104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:08.351481 2104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=33893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:08.352492 2104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:08.353549 2104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:08.361929 2109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:08.361919 2111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:08.361994 2104 server_base.cc:1034] running on GCE node
W20260811 04:51:08.361989 2113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:08.362808 2104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:08.363852 2104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:08.365053 2104 hybrid_clock.cc:648] HybridClock initialized: now 1786423868365036 us; error 28 us; skew 500 ppm
Aug 11 04:51:08 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423868, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:08.367779 2104 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:08.368558 2104 webserver.cc:460] Webserver started at http://127.17.188.126:33893/ using document root <none> and password file <none>
I20260811 04:51:08.369074 2104 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:08.369141 2104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:08.372812 2104 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:08.374891 2120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:08.376083 2104 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:08.376228 2104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "4fc3bd2382814daaa4df8b082f055f5c"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "91678c06e796259bb5364c1c90dbfbc8"
server_key_iv: "ada07985cd23da089590d968a28f2b71"
server_key_version: "encryptionkey@0"
I20260811 04:51:08.376749 2104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:08.402547 2104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:08.405918 2104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:08.406126 2104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:08.413174 2104 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36339
I20260811 04:51:08.413434 2177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36339 every 8 connection(s)
I20260811 04:51:08.414299 2104 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:08.418365 2178 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:51:08.419947 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap starting.
I20260811 04:51:08.420377 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2104
I20260811 04:51:08.420852 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:37499
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=39145
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:08.445020 2178 log.cc:824] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:08.459554 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:08.460001 2178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c: Bootstrap complete.
I20260811 04:51:08.465512 2178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:08.466094 2178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Initialized, Role: FOLLOWER
I20260811 04:51:08.466660 2178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:08.466795 2178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:08.466859 2178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:08.466952 2178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 2 FOLLOWER]: Advancing to term 3
I20260811 04:51:08.469250 2178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:08.469612 2178 leader_election.cc:302] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4fc3bd2382814daaa4df8b082f055f5c; no voters:
I20260811 04:51:08.470038 2178 leader_election.cc:288] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 04:51:08.470147 2182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 3 FOLLOWER]: Leader election won for term 3
I20260811 04:51:08.470383 2182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [term 3 LEADER]: Becoming Leader. State: Replica: 4fc3bd2382814daaa4df8b082f055f5c, State: Running, Role: LEADER
I20260811 04:51:08.470686 2182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } }
I20260811 04:51:08.471274 2178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:08.472029 2182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4fc3bd2382814daaa4df8b082f055f5c. Latest consensus state: current_term: 3 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:08.472149 2182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:08.472501 2189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:08.472632 2183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4fc3bd2382814daaa4df8b082f055f5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4fc3bd2382814daaa4df8b082f055f5c" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36339 } } }
I20260811 04:51:08.472797 2183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4fc3bd2382814daaa4df8b082f055f5c [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:08.477597 2189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:08.478302 2189 catalog_manager.cc:1259] Loaded cluster ID: 87379799a41649aea6aa20a28d5a08a7
I20260811 04:51:08.478356 2189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 04:51:08.479329 2189 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fce345079ad google::LogMessage::Fail() at ??:0
@ 0x7fce3450a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fce345074de google::LogMessage::Flush() at ??:0
@ 0x7fce34508a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fce3ee46fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fce3ee47d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fce3ee44579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fce3ee88640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fce367593d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fce36759c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fce3675b3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fce3674a512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fce37d8e6db start_thread at ??:0
@ 0x7fce3300561f clone at ??:0
W20260811 04:51:08.583177 2180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:08.583423 2180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:08.583467 2180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:08.587481 2180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:08.587536 2180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:08.587594 2180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:51:08.592968 2180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:37499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=39145
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:08.594144 2180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:08.595196 2180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:08.605798 2224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:08.605799 2223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:08.606050 2180 server_base.cc:1034] running on GCE node
W20260811 04:51:08.606055 2226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:08.606498 2180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:08.607185 2180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:08.608374 2180 hybrid_clock.cc:648] HybridClock initialized: now 1786423868608348 us; error 44 us; skew 500 ppm
Aug 11 04:51:08 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423868, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:08.611367 2180 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:51:08.612295 2180 webserver.cc:460] Webserver started at http://127.17.188.65:39145/ using document root <none> and password file <none>
I20260811 04:51:08.612890 2180 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:08.612985 2180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:08.617069 2180 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:51:08.619360 2234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:08.620651 2180 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:08.620784 2180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "436effdb6c0343adbb4f32aac6b98751"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "c931ba89b1b68160dad7050f24c2c494"
server_key_iv: "dd1c63f83fe6609abee253e09051d749"
server_key_version: "encryptionkey@0"
I20260811 04:51:08.621321 2180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:08.649353 2180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:08.653069 2180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:08.653311 2180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:08.654052 2180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:08.655262 2241 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 04:51:08.660953 2180 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 04:51:08.661054 2180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260811 04:51:08.661224 2180 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 04:51:08.662982 2180 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 04:51:08.663053 2180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:08.663383 2241 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Bootstrap starting.
I20260811 04:51:08.674072 2180 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37499
I20260811 04:51:08.675048 2180 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:51:08.675866 2361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37499 every 8 connection(s)
I20260811 04:51:08.680637 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2180
I20260811 04:51:08.681137 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:35713
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=39835
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:08.686041 2241 log.cc:824] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Log is configured to *not* fsync() on all Append() calls
W20260811 04:51:08.689038 2365 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:51:08.677204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:37783)
0811 04:51:08.677750 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.677803 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:08.679141 (+ 1338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:08.688261 (+ 9120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":148,"threads_started":1}
W20260811 04:51:08.689508 2362 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36339 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:36339: Client connection negotiation failed: client connection to 127.17.188.126:36339: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:51:08.690317 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.690060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:34649)
0811 04:51:08.690184 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.690265 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 04:51:08.690964 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.690761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:44795)
0811 04:51:08.690867 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.690912 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 04:51:08.691198 2362 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 04:51:08.696101 2241 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:08.696521 2241 tablet_bootstrap.cc:492] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Bootstrap complete.
I20260811 04:51:08.698118 2241 ts_tablet_manager.cc:1397] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Time spent bootstrapping tablet: real 0.035s user 0.018s sys 0.016s
I20260811 04:51:08.701162 2241 raft_consensus.cc:348] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:08.701733 2241 raft_consensus.cc:729] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 436effdb6c0343adbb4f32aac6b98751, State: Initialized, Role: FOLLOWER
I20260811 04:51:08.702219 2241 consensus_queue.cc:260] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:08.703289 2241 ts_tablet_manager.cc:1428] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:51:08.703272 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.703056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:48739)
0811 04:51:08.703167 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.703213 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 04:51:08.703994 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.703776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:59915)
0811 04:51:08.703893 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.703938 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 04:51:08.799576 2366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:08.799880 2366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:08.799958 2366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:08.804267 2366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:08.804354 2366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:08.804438 2366 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:51:08.809501 2366 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:35713
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=39835
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:08.810668 2366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:08.811693 2366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:08.821514 2378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:08.821627 2376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:08.821527 2375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:08.821868 2366 server_base.cc:1034] running on GCE node
I20260811 04:51:08.822243 2366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:08.822875 2366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:08.824082 2366 hybrid_clock.cc:648] HybridClock initialized: now 1786423868824050 us; error 49 us; skew 500 ppm
Aug 11 04:51:08 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423868, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:08.827031 2366 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:51:08.827816 2366 webserver.cc:460] Webserver started at http://127.17.188.66:39835/ using document root <none> and password file <none>
I20260811 04:51:08.828320 2366 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:08.828377 2366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:08.832103 2366 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:08.834102 2385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:08.835327 2366 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:08.835448 2366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "61fd895ab8a84745a13c6ba659fe5bfa"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "7f087306d493fec50172cdd498f65ade"
server_key_iv: "d5874c4cad20c7ef8e1ec20e45c674cb"
server_key_version: "encryptionkey@0"
I20260811 04:51:08.835973 2366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:08.867367 2366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:08.870994 2366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:08.871215 2366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:08.871842 2366 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:08.872711 2366 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:08.872767 2366 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:08.872845 2366 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:08.872882 2366 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:08.882182 2366 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:35713
I20260811 04:51:08.882262 2509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:35713 every 8 connection(s)
I20260811 04:51:08.883213 2366 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:51:08.887085 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.885280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:55475)
0811 04:51:08.885819 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.885937 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":122,"threads_started":1}
W20260811 04:51:08.887540 2510 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36339 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:36339: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
I20260811 04:51:08.888091 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.887892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:37027)
0811 04:51:08.887994 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.888040 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 04:51:08.888741 2512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:08.888550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:55283)
0811 04:51:08.888654 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:08.888696 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 04:51:08.888958 2510 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 04:51:08.890481 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2366
I20260811 04:51:08.890920 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:44197
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:36339
--webserver_port=37643
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:09.001181 2513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:09.001559 2513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:09.001830 2513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:09.005879 2513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:09.005957 2513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:09.006065 2513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:51:09.011085 2513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:44197
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=37643
--tserver_master_addrs=127.17.188.126:36339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:09.012044 2513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:09.013059 2513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:51:09.022462 2513 server_base.cc:1034] running on GCE node
W20260811 04:51:09.022426 2522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:09.022433 2519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:09.022428 2520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:09.023068 2513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:09.023626 2513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:09.024786 2513 hybrid_clock.cc:648] HybridClock initialized: now 1786423869024772 us; error 25 us; skew 500 ppm
Aug 11 04:51:09 dist-test-slave-njxd krb5kdc[914](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423869, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:09.027576 2513 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:51:09.028465 2513 webserver.cc:460] Webserver started at http://127.17.188.67:37643/ using document root <none> and password file <none>
I20260811 04:51:09.029011 2513 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:09.029100 2513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:09.032799 2513 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:09.034973 2529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:09.036103 2513 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:09.036239 2513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "802eb4f5f3524bb3869cc48abc4bd3b7"
format_stamp: "Formatted at 2026-08-11 04:51:06 on dist-test-slave-njxd"
server_key: "ad157a7b722fa6867bc6209ecf65bd36"
server_key_iv: "d466575b1789f0689e68d831c777bc3a"
server_key_version: "encryptionkey@0"
I20260811 04:51:09.036808 2513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:09.065954 2513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:09.068848 2513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:09.069064 2513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:09.069953 2513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:09.070784 2513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:09.070868 2513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:09.070940 2513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:09.070974 2513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:09.082715 2513 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44197
I20260811 04:51:09.083912 2513 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:51:09.084703 2653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44197 every 8 connection(s)
I20260811 04:51:09.087993 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2513
I20260811 04:51:09.088768 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.086355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:52921)
0811 04:51:09.086901 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.087040 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":148,"threads_started":1}
W20260811 04:51:09.089525 2654 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:36339 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:36339: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
I20260811 04:51:09.090176 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.089982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:35523)
0811 04:51:09.090070 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.090123 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 04:51:09.090934 2656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.090710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:40263)
0811 04:51:09.090832 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.090885 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260811 04:51:09.091111 2654 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 04:51:09.705142 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.704678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:48691)
0811 04:51:09.704962 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.705022 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":75,"threads_started":1}
I20260811 04:51:09.842543 2659 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:09.842772 2659 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:09.843875 2659 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
Aug 11 04:51:09 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423868, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.67@KRBTEST.COM
Aug 11 04:51:09 dist-test-slave-njxd krb5kdc[914](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423868, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.66@KRBTEST.COM
I20260811 04:51:09.857928 2660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.844085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:35713 (local address 127.17.188.65:39799)
0811 04:51:09.844567 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.844581 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:09.844700 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:09.846581 (+ 1881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:09.846583 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:09.846820 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:09.847328 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:09.847341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.848638 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.848641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:09.849477 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:09.849486 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.850243 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.850247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:09.850451 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:09.851297 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:09.851313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:09.853397 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:09.855422 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:09.855427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:09.855429 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:09.855695 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:09.856072 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:09.856075 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:09.856077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:09.856220 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:09.856927 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:09.856932 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:09.857143 (+ 211us) client_negotiation.cc:769] Sending connection context
0811 04:51:09.857339 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 04:51:09.857713 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":281,"spinlock_wait_cycles":16640,"thread_start_us":75,"threads_started":1}
I20260811 04:51:09.857939 2663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.844308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:39799 (local address 127.17.188.66:35713)
0811 04:51:09.844700 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:09.844714 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:09.844755 (+ 41us) server_negotiation.cc:407] Connection header received
0811 04:51:09.845494 (+ 739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:09.845502 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:09.845952 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:09.846249 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:09.847503 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.848482 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.849633 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.850092 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.850276 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:09.853631 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:09.853643 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:09.853665 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:09.853692 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:09.855305 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:09.855831 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:09.855836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:09.855841 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:09.855981 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:09.856318 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:09.856321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:09.856323 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:09.856785 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:09.856935 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:09.857447 (+ 512us) server_negotiation.cc:299] Negotiation successful
0811 04:51:09.857738 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":73,"threads_started":1}
I20260811 04:51:09.857976 2662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.844290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:54405 (local address 127.17.188.67:44197)
0811 04:51:09.844615 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:09.844628 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:09.844670 (+ 42us) server_negotiation.cc:407] Connection header received
0811 04:51:09.845437 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:09.845445 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:09.845952 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:09.846226 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:09.847502 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.848481 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.849668 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.850096 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.850274 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:09.853283 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:09.853288 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:09.853299 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:09.853325 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:09.855209 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:09.855799 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:09.855807 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:09.855819 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:09.855929 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:09.856534 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:09.856537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:09.856538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:09.856923 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:09.857063 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:09.857451 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 04:51:09.857783 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":68,"threads_started":1}
I20260811 04:51:09.857972 2658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.844085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44197 (local address 127.17.188.65:54405)
0811 04:51:09.844239 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.844256 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:09.844365 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:09.846311 (+ 1946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:09.846317 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:09.846822 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:09.847326 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:09.847341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.848640 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.848643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:09.849480 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:09.849490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:09.850220 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:09.850224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:09.850448 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:09.851351 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:09.851363 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:09.853002 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:09.855345 (+ 2343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:09.855351 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:09.855365 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:09.855665 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:09.856317 (+ 652us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:09.856322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:09.856327 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:09.856423 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:09.857035 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:09.857038 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:09.857159 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 04:51:09.857339 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 04:51:09.857800 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68,"mutex_wait_us":288,"spinlock_wait_cycles":8576}
W20260811 04:51:09.861271 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:09.861414 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:09.861486 2237 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:09.861770 2659 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:09.889832 2664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:09.889422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:47781)
0811 04:51:09.889701 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:09.889748 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":71,"threads_started":1}
I20260811 04:51:10.092020 2665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:10.091619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:41001)
0811 04:51:10.091871 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:10.091921 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260811 04:51:10.706429 2666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:10.705988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:38761)
0811 04:51:10.706274 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:10.706333 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":82,"threads_started":1}
I20260811 04:51:10.890929 2667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:10.890535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:57419)
0811 04:51:10.890770 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:10.890821 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":71,"threads_started":1}
I20260811 04:51:11.093096 2668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:11.092688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:51109)
0811 04:51:11.092926 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:11.092996 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":74,"threads_started":1}
I20260811 04:51:11.415264 2669 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:11.415428 2669 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:11.415947 2669 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
W20260811 04:51:11.416795 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:11.416905 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:11.417100 2235 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:11.417284 2669 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:11.707674 2670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:11.707186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:38485)
0811 04:51:11.707513 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:11.707575 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":79,"threads_started":1}
I20260811 04:51:11.892081 2671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:11.891627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:60689)
0811 04:51:11.891892 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:11.891960 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":71,"threads_started":1}
I20260811 04:51:12.094254 2672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:12.093861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:48319)
0811 04:51:12.094107 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:12.094168 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":87,"threads_started":1}
I20260811 04:51:12.708912 2673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:12.708509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:42177)
0811 04:51:12.708765 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:12.708819 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":74,"threads_started":1}
I20260811 04:51:12.893324 2674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:12.892919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:37049)
0811 04:51:12.893185 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:12.893238 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":88,"threads_started":1}
I20260811 04:51:13.095547 2675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:13.095116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:55527)
0811 04:51:13.095389 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:13.095451 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":92,"threads_started":1}
I20260811 04:51:13.710587 2676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:13.710133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:33103)
0811 04:51:13.710421 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:13.710488 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":96,"threads_started":1}
I20260811 04:51:13.894654 2678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:13.894170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:56837)
0811 04:51:13.894467 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:13.894527 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":116,"threads_started":1}
I20260811 04:51:14.096827 2679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:14.096381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:39475)
0811 04:51:14.096670 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:14.096734 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":99,"threads_started":1}
I20260811 04:51:14.107553 2680 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:14.107693 2680 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:14.108160 2680 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
W20260811 04:51:14.108986 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:14.109125 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:14.109253 2235 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:14.109416 2680 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:14.711836 2681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:14.711405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:36471)
0811 04:51:14.711672 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:14.711728 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":74,"threads_started":1}
I20260811 04:51:14.895742 2683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:14.895353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:38189)
0811 04:51:14.895589 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:14.895646 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":71,"threads_started":1}
I20260811 04:51:15.097995 2684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:15.097555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:49817)
0811 04:51:15.097854 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:15.097906 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":85,"threads_started":1}
I20260811 04:51:15.713143 2685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:15.712732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:33471)
0811 04:51:15.712990 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:15.713047 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":87,"threads_started":1}
I20260811 04:51:15.896991 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:15.896486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:46793)
0811 04:51:15.896825 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:15.896883 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260811 04:51:16.099097 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:16.098664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:53693)
0811 04:51:16.098958 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:16.099009 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":85,"threads_started":1}
I20260811 04:51:16.714470 2688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:16.714024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:35425)
0811 04:51:16.714309 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:16.714372 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":98,"threads_started":1}
I20260811 04:51:16.898535 2689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:16.897939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:55769)
0811 04:51:16.898305 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:16.898398 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260811 04:51:17.004885 2690 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:17.005021 2690 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:17.005549 2690 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
W20260811 04:51:17.006356 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:17.006490 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:17.006593 2235 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:17.006775 2690 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:17.100204 2691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:17.099793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:35431)
0811 04:51:17.100065 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:17.100123 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":108,"threads_started":1}
I20260811 04:51:17.715637 2692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:17.715238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:41209)
0811 04:51:17.715482 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:17.715538 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":79,"threads_started":1}
I20260811 04:51:17.900003 2693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:17.899433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:41805)
0811 04:51:17.899774 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:17.899868 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":86,"threads_started":1}
I20260811 04:51:18.101318 2694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:18.100882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:53481)
0811 04:51:18.101175 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:18.101231 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":86,"threads_started":1}
I20260811 04:51:18.717199 2695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:18.716624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:35599)
0811 04:51:18.716980 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:18.717050 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":96,"threads_started":1}
I20260811 04:51:18.901154 2697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:18.900765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:41029)
0811 04:51:18.901005 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:18.901057 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":74,"threads_started":1}
I20260811 04:51:19.102541 2698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:19.102144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:44965)
0811 04:51:19.102394 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:19.102449 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":75,"threads_started":1}
I20260811 04:51:19.718358 2700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:19.717975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:57455)
0811 04:51:19.718209 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:19.718263 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":72,"threads_started":1}
I20260811 04:51:19.902324 2701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:19.901922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:34461)
0811 04:51:19.902170 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:19.902225 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
I20260811 04:51:20.103878 2702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:20.103437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:47057)
0811 04:51:20.103703 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:20.103779 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":80,"threads_started":1}
I20260811 04:51:20.719681 2703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:20.719227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:57231)
0811 04:51:20.719513 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:20.719576 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260811 04:51:20.903523 2704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:20.903124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:43923)
0811 04:51:20.903371 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:20.903427 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":76,"threads_started":1}
I20260811 04:51:21.105064 2705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:21.104672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:41931)
0811 04:51:21.104913 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:21.104969 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260811 04:51:21.118467 2706 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:21.118650 2706 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:21.119102 2706 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
W20260811 04:51:21.119836 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:21.119940 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:21.120065 2237 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:21.120239 2706 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:21.721045 2707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:21.720624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:38421)
0811 04:51:21.720904 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:21.720956 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":74,"threads_started":1}
I20260811 04:51:21.904726 2708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:21.904302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:55855)
0811 04:51:21.904565 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:21.904624 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":84,"threads_started":1}
I20260811 04:51:22.106320 2709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:22.105851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:44459)
0811 04:51:22.106151 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:22.106223 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":92,"threads_started":1}
I20260811 04:51:22.722334 2710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:22.721905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:36329)
0811 04:51:22.722180 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:22.722236 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":94,"threads_started":1}
I20260811 04:51:22.905961 2711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:22.905522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:55669)
0811 04:51:22.905808 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:22.905860 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":124,"threads_started":1}
I20260811 04:51:23.107450 2713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:23.107023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:57855)
0811 04:51:23.107296 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:23.107351 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":103,"threads_started":1}
I20260811 04:51:23.723845 2714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:23.723422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.65:33403)
0811 04:51:23.723696 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:23.723747 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":88,"threads_started":1}
I20260811 04:51:23.907295 2715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:23.906859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.66:42059)
0811 04:51:23.907135 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:23.907197 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":74,"threads_started":1}
I20260811 04:51:23.934136 2716 raft_consensus.cc:482] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:23.934365 2716 raft_consensus.cc:504] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "802eb4f5f3524bb3869cc48abc4bd3b7" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44197 } } peers { permanent_uuid: "61fd895ab8a84745a13c6ba659fe5bfa" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 35713 } } peers { permanent_uuid: "436effdb6c0343adbb4f32aac6b98751" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37499 } }
I20260811 04:51:23.934916 2716 leader_election.cc:288] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197), 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713)
W20260811 04:51:23.935720 2235 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 61fd895ab8a84745a13c6ba659fe5bfa (127.17.188.66:35713): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
W20260811 04:51:23.935855 2237 leader_election.cc:341] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 802eb4f5f3524bb3869cc48abc4bd3b7 (127.17.188.67:44197): Not found: Tablet not found: 3b34cec6e3794763a444f69db2e7e79d
I20260811 04:51:23.935948 2237 leader_election.cc:302] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 436effdb6c0343adbb4f32aac6b98751; no voters: 61fd895ab8a84745a13c6ba659fe5bfa, 802eb4f5f3524bb3869cc48abc4bd3b7
I20260811 04:51:23.936131 2716 raft_consensus.cc:2726] T 3b34cec6e3794763a444f69db2e7e79d P 436effdb6c0343adbb4f32aac6b98751 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:51:24.093214 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2180
I20260811 04:51:24.102430 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2366
I20260811 04:51:24.108971 2717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:24.108410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:36339 (local address 127.17.188.67:37057)
0811 04:51:24.108751 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:24.108830 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:36339: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":68,"threads_started":1}
I20260811 04:51:24.110316 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2513
2026-08-11T04:51:24Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19439 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:51:24 dist-test-slave-njxd krb5kdc[2721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:51:24 dist-test-slave-njxd krb5kdc[2721](info): set up 2 sockets
Aug 11 04:51:24 dist-test-slave-njxd krb5kdc[2721](info): commencing operation
krb5kdc: starting...
W20260811 04:51:25.218693 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:51:25 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:51:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:51:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:51:25.349372 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:43401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:25.474504 2735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:25.474813 2735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:25.474855 2735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:25.479005 2735 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 04:51:25.479063 2735 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 04:51:25.479079 2735 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 04:51:25.479092 2735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:25.479111 2735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:25.479130 2735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:25.479146 2735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:25.479162 2735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:25.484366 2735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:43401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:25.485636 2735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:25.486645 2735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:25.495177 2740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:25.495218 2735 server_base.cc:1034] running on GCE node
W20260811 04:51:25.495239 2742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:25.495291 2744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:25.496037 2735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:25.497081 2735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:25.498281 2735 hybrid_clock.cc:648] HybridClock initialized: now 1786423885498260 us; error 42 us; skew 500 ppm
Aug 11 04:51:25 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423885, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:25.501221 2735 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:25.502188 2735 webserver.cc:460] Webserver started at http://127.17.188.126:35649/ using document root <none> and password file <none>
I20260811 04:51:25.502708 2735 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:25.502768 2735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:25.503001 2735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:25.505020 2735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "70264a025c644ede8d4fc64437883c69"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "fdec6f9da8ad17415e7f6e3866904656"
server_key_iv: "fc73ab13e09043dcc9fc6d4efe8eb549"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.505658 2735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "70264a025c644ede8d4fc64437883c69"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "fdec6f9da8ad17415e7f6e3866904656"
server_key_iv: "fc73ab13e09043dcc9fc6d4efe8eb549"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.509358 2735 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:51:25.511701 2752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:25.512977 2735 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:25.513136 2735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "70264a025c644ede8d4fc64437883c69"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "fdec6f9da8ad17415e7f6e3866904656"
server_key_iv: "fc73ab13e09043dcc9fc6d4efe8eb549"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.513243 2735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:25.529753 2735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:25.533037 2735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:25.533248 2735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:25.540446 2735 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:43401
I20260811 04:51:25.540762 2815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:43401 every 8 connection(s)
I20260811 04:51:25.541429 2735 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:25.544168 2817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:25.546291 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2735
I20260811 04:51:25.546444 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:51:25.546720 18161 external_mini_cluster.cc:1428] Setting key d7c645b782873d6b745544124cba6c7c
I20260811 04:51:25.550239 2817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap starting.
I20260811 04:51:25.552718 2817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:25.553521 2817 log.cc:824] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:25.555986 2817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: No bootstrap required, opened a new log
Aug 11 04:51:25 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:25.559232 2817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:25.559465 2817 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:25.559525 2817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Initialized, Role: FOLLOWER
I20260811 04:51:25.559921 2817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:25.560081 2817 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:25.560179 2817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:25.560277 2817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:25.561419 2817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:25.561762 2817 leader_election.cc:302] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70264a025c644ede8d4fc64437883c69; no voters:
I20260811 04:51:25.562059 2817 leader_election.cc:288] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:51:25.562163 2822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:25.562376 2822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 LEADER]: Becoming Leader. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Running, Role: LEADER
I20260811 04:51:25.562467 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:25.548175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34120 (local address 127.17.188.126:43401)
0811 04:51:25.548572 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:25.548588 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:25.548625 (+ 37us) server_negotiation.cc:407] Connection header received
0811 04:51:25.549302 (+ 677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:25.549319 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:25.549720 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:25.549995 (+ 275us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:25.550919 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.551886 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.553068 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.553518 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.553789 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:25.556837 (+ 3048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:25.556843 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:25.556856 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:25.556882 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:25.559215 (+ 2333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:25.559699 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:25.559704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:25.559710 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:25.559869 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:25.560206 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:25.560209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:25.560211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:25.560655 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:25.560828 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:25.561148 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 04:51:25.561463 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":131,"threads_started":1}
I20260811 04:51:25.562748 2822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:25.563289 2817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:25.566073 2823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:51:25.566159 2824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70264a025c644ede8d4fc64437883c69. Latest consensus state: current_term: 1 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:51:25.566318 2824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:25.566515 2823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
W20260811 04:51:25.568140 2839 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:51:25.568225 2839 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:51:25.568302 2840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:25.568960 2840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:25.573663 2840 catalog_manager.cc:1347] Generated new cluster ID: 7c0163f222464237a61eb2a5b24d9e20
I20260811 04:51:25.573722 2840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:25.598455 2840 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:51:25.599427 2840 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:25.605116 2840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Generated new TSK 0
I20260811 04:51:25.605854 2840 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:51:25.645040 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:25.761173 2846 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:25.761571 2846 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:25.761679 2846 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:25.766044 2846 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:25.766139 2846 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:25.766230 2846 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:51:25.771517 2846 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2846
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:25.772675 2846 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:25.773759 2846 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:25.783800 2854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:25.783854 2851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:25.783811 2852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:25.783893 2846 server_base.cc:1034] running on GCE node
I20260811 04:51:25.784477 2846 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:25.785264 2846 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:25.786456 2846 hybrid_clock.cc:648] HybridClock initialized: now 1786423885786419 us; error 48 us; skew 500 ppm
Aug 11 04:51:25 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423885, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:25.789274 2846 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:51:25.790199 2846 webserver.cc:460] Webserver started at http://127.17.188.65:33707/ using document root <none> and password file <none>
I20260811 04:51:25.790763 2846 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:25.790831 2846 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:25.791046 2846 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:25.793148 2846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "cc7d16ac755daf7a7351568e905b3ed5"
server_key_iv: "b5e1bea79c33f0682223fd45d762cd15"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.793787 2846 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "cc7d16ac755daf7a7351568e905b3ed5"
server_key_iv: "b5e1bea79c33f0682223fd45d762cd15"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.797789 2846 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 04:51:25.800347 2863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:25.801741 2846 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:51:25.801878 2846 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "cc7d16ac755daf7a7351568e905b3ed5"
server_key_iv: "b5e1bea79c33f0682223fd45d762cd15"
server_key_version: "encryptionkey@0"
I20260811 04:51:25.802000 2846 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:25.813848 2846 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:25.816897 2846 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:25.817097 2846 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:25.817791 2846 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:25.818590 2846 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:25.818666 2846 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:25.818739 2846 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:25.818790 2846 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:25.827822 2846 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37947
I20260811 04:51:25.827852 2989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37947 every 8 connection(s)
I20260811 04:51:25.828709 2846 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:51:25.833168 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2846
I20260811 04:51:25.833362 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:51:25.833757 18161 external_mini_cluster.cc:1428] Setting key e6573c865f778550597b7ca4ba7114ff
Aug 11 04:51:25 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423885, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:25.843564 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:25.830537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:39277 (local address 127.17.188.126:43401)
0811 04:51:25.830690 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:25.830694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:25.831516 (+ 822us) server_negotiation.cc:407] Connection header received
0811 04:51:25.833234 (+ 1718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:25.833238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:25.833298 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:25.833382 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:25.834919 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.835587 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.836766 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.837010 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.837134 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:25.839686 (+ 2552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:25.839690 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:25.839692 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:25.839727 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:25.841295 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:25.841948 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:25.841952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:25.841953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:25.842048 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:25.842431 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:25.842434 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:25.842436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:25.842635 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:25.842746 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:25.843260 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 04:51:25.843388 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
I20260811 04:51:25.844409 2992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:25.830919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:39277)
0811 04:51:25.831358 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:25.831402 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:25.832984 (+ 1582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:25.833669 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:25.833679 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:25.834181 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:25.834761 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:25.834775 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.835718 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.835722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:25.836633 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:25.836642 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:25.837173 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:25.837178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:25.837375 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:25.838026 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:25.838042 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:25.839511 (+ 1469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:25.841439 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:25.841446 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:25.841461 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:25.841832 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:25.842161 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:25.842165 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:25.842167 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:25.842325 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:25.842746 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:25.842753 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:25.843008 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 04:51:25.843201 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 04:51:25.843536 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":113,"threads_started":1}
I20260811 04:51:25.845717 2990 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:25.845945 2990 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:25.846462 2990 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
I20260811 04:51:25.848156 2774 ts_manager.cc:194] Registered new tserver with Master: 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947)
I20260811 04:51:25.849300 2774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:39277
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:51:25.864603 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:25.980722 2995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:25.980952 2995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:25.980993 2995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:25.985020 2995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:25.985078 2995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:25.985169 2995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:51:25.990259 2995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:25.991253 2995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:25.992264 2995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:26.001940 3002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:26.002064 3003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:26.002175 2995 server_base.cc:1034] running on GCE node
W20260811 04:51:26.002158 3006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:26.002728 2995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:26.003368 2995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:26.004556 2995 hybrid_clock.cc:648] HybridClock initialized: now 1786423886004523 us; error 58 us; skew 500 ppm
Aug 11 04:51:26 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423886, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:26.007424 2995 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:51:26.008249 2995 webserver.cc:460] Webserver started at http://127.17.188.66:45997/ using document root <none> and password file <none>
I20260811 04:51:26.008849 2995 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:26.008939 2995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:26.009169 2995 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:26.011260 2995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "340fb73aae1cb0e6424d05866fd83c52"
server_key_iv: "2864fd19fd5dfd573043421f9f336723"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.011848 2995 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "340fb73aae1cb0e6424d05866fd83c52"
server_key_iv: "2864fd19fd5dfd573043421f9f336723"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.015539 2995 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:51:26.018155 3013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.019290 2995 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:26.019423 2995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "340fb73aae1cb0e6424d05866fd83c52"
server_key_iv: "2864fd19fd5dfd573043421f9f336723"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.019533 2995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:26.036532 2995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:26.039309 2995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:26.039502 2995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:26.040063 2995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:26.040863 2995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:26.040934 2995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.041002 2995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:26.041049 2995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.049811 2995 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:41849
I20260811 04:51:26.049849 3136 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:41849 every 8 connection(s)
I20260811 04:51:26.050673 2995 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:51:26.051749 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 2995
I20260811 04:51:26.051874 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:51:26.052155 18161 external_mini_cluster.cc:1428] Setting key 1e259d1084369acc68672fac45f21678
Aug 11 04:51:26 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423886, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:51:26.065619 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.052515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:56137 (local address 127.17.188.126:43401)
0811 04:51:26.052647 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.052656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.053643 (+ 987us) server_negotiation.cc:407] Connection header received
0811 04:51:26.055071 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.055078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.055143 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.055237 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:26.056458 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.057011 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.058264 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.058590 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.058706 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.061323 (+ 2617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:26.061326 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:26.061328 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:26.061353 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:26.063053 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.063708 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.063711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.063713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.063807 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.064171 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.064176 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.064180 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.064491 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:26.064594 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.065141 (+ 547us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.065312 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:51:26.066908 3139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.052958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:56137)
0811 04:51:26.053438 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.053491 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.054846 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.055411 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.055418 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.055818 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:26.056290 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.056304 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.057152 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.057157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.058129 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.058139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.058750 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.058755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.058926 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.059531 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:26.059570 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:26.061151 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:26.063173 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:26.063178 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:26.063190 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:26.063537 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:26.063906 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:26.063908 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:26.063910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:26.064053 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:26.064616 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:26.064621 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:26.064876 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.065082 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.065415 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":144,"threads_started":1}
I20260811 04:51:26.068406 3137 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:26.068655 3137 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:26.069165 3137 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
I20260811 04:51:26.070399 2774 ts_manager.cc:194] Registered new tserver with Master: 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:26.071019 2774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:56137
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:51:26.082631 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:26.194811 3142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:26.195096 3142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:26.195189 3142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:26.199224 3142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:26.199301 3142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:26.199386 3142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:51:26.204495 3142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3142
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:26.205655 3142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:26.206682 3142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:26.216979 3147 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:26.217042 3142 server_base.cc:1034] running on GCE node
W20260811 04:51:26.216971 3152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:26.216987 3149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:26.217732 3142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:26.218326 3142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:26.219515 3142 hybrid_clock.cc:648] HybridClock initialized: now 1786423886219500 us; error 29 us; skew 500 ppm
Aug 11 04:51:26 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423886, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:26.222366 3142 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:51:26.223352 3142 webserver.cc:460] Webserver started at http://127.17.188.67:36217/ using document root <none> and password file <none>
I20260811 04:51:26.223935 3142 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:26.224028 3142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:26.224279 3142 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:51:26.226431 3142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "2c8917e8262d4bd680a1f15fb82b5201"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "ef1a7c80c1097fee8bfb1c7a7ea4756a"
server_key_iv: "e566c7b108c3e9ebd390823822cb6e74"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.226990 3142 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "2c8917e8262d4bd680a1f15fb82b5201"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "ef1a7c80c1097fee8bfb1c7a7ea4756a"
server_key_iv: "e566c7b108c3e9ebd390823822cb6e74"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.230677 3142 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:51:26.233031 3161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.234334 3142 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:51:26.234467 3142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "2c8917e8262d4bd680a1f15fb82b5201"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "ef1a7c80c1097fee8bfb1c7a7ea4756a"
server_key_iv: "e566c7b108c3e9ebd390823822cb6e74"
server_key_version: "encryptionkey@0"
I20260811 04:51:26.234579 3142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:26.258279 3142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:26.261492 3142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:26.261739 3142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:26.262427 3142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:26.263370 3142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:26.263439 3142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.263514 3142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:26.263567 3142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:26.273142 3142 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43347
I20260811 04:51:26.273166 3287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43347 every 8 connection(s)
I20260811 04:51:26.274056 3142 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:51:26.279467 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3142
I20260811 04:51:26.279637 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:51:26.279927 18161 external_mini_cluster.cc:1428] Setting key c53056aaeb2355c4a1d13650548e5f40
Aug 11 04:51:26 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423886, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:26.287961 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.275890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:43703 (local address 127.17.188.126:43401)
0811 04:51:26.276031 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.276035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.276854 (+ 819us) server_negotiation.cc:407] Connection header received
0811 04:51:26.278276 (+ 1422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.278280 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.278339 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.278417 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:26.279669 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.280307 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.281643 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.281867 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.281961 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.284585 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:26.284588 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:26.284590 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:26.284616 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:26.286126 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.286625 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.286627 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.286629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.286704 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.286989 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.286991 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.286993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.287161 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:26.287248 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.287744 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.287843 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:51:26.288790 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.276271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:43703)
0811 04:51:26.276711 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.276752 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.278049 (+ 1297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.278587 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.278593 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.278946 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:26.279499 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.279513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.280436 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.280440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.281472 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.281483 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.282029 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.282038 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.282274 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.282817 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:26.282833 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:26.284396 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:26.286241 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:26.286246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:26.286257 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:26.286517 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:26.286784 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:26.286786 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:26.286787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:26.286910 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:26.287297 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:26.287302 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:26.287526 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.287697 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.287946 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":122,"threads_started":1}
I20260811 04:51:26.289960 3288 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:26.290186 3288 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:26.290620 3288 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
I20260811 04:51:26.291597 2774 ts_manager.cc:194] Registered new tserver with Master: 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347)
I20260811 04:51:26.292212 2774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:43703
I20260811 04:51:26.294241 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:51:26.304057 2820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.296248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34128 (local address 127.17.188.126:43401)
0811 04:51:26.296409 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.296413 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.296608 (+ 195us) server_negotiation.cc:407] Connection header received
0811 04:51:26.296737 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.296741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.296789 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.296874 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:26.297878 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.298394 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.299256 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.299478 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.299590 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.301003 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:26.301007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:26.301009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:26.301040 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:26.302346 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.302778 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.302782 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.302784 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.302867 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:26.303158 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:26.303174 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:26.303176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:26.303386 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:26.303533 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.303776 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.303892 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:51:26.307128 2774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:51:26.310125 2774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:51:26.324683 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.319026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43360 (local address 127.17.188.67:43347)
0811 04:51:26.319849 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.319865 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.319890 (+ 25us) server_negotiation.cc:407] Connection header received
0811 04:51:26.319961 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.319966 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.320142 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.320582 (+ 440us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:26.320738 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.321847 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.323182 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.323992 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.324085 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.324204 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.324437 (+ 233us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.324537 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":724,"thread_start_us":155,"threads_started":1}
I20260811 04:51:26.324695 3303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.318712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41849 (local address 127.0.0.1:36714)
0811 04:51:26.319519 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.319532 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.319601 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.320181 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.320187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.320229 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:26.320401 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.320407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.321430 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.321436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.322898 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.322908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.324270 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.324273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.324348 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.324396 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.324468 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.324540 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":2,"spinlock_wait_cycles":17152,"thread_start_us":85,"threads_started":1}
I20260811 04:51:26.324666 3304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.318429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43347 (local address 127.0.0.1:43360)
0811 04:51:26.319221 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.319273 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.319400 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.320300 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.320303 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.320316 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:26.320426 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.320433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.322002 (+ 1569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.322006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.323058 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.323066 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.324117 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.324121 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.324236 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.324278 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.324387 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.324498 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":22,"spinlock_wait_cycles":2944,"thread_start_us":101,"threads_started":1}
I20260811 04:51:26.325124 3306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.319089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36714 (local address 127.17.188.66:41849)
0811 04:51:26.319724 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.319736 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.319759 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:51:26.319838 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.319843 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.320019 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.320181 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:26.320524 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.321279 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.323026 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.323926 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.324047 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.324204 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.324906 (+ 702us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.325009 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":116,"threads_started":1}
I20260811 04:51:26.328212 3065 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 (DEFAULT_TABLE table=test-table [id=4550d8dd07714baebef831d4b53dde02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:26.328213 3215 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 (DEFAULT_TABLE table=test-table [id=4550d8dd07714baebef831d4b53dde02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:26.329389 3065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8b58ba0e814fa6a5b247f1a427d797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:26.329525 3301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.318221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.0.0.1:40814)
0811 04:51:26.319222 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.319274 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.319400 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.320181 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.320187 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.320223 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:26.320427 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.320433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.321944 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.321948 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.323844 (+ 1896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.323853 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.329065 (+ 5212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.329068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.329194 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.329220 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.329301 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.329374 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"mutex_wait_us":59,"spinlock_wait_cycles":4096,"thread_start_us":64,"threads_started":1}
I20260811 04:51:26.330013 3302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.318389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40814 (local address 127.17.188.65:37947)
0811 04:51:26.318820 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.318834 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.319364 (+ 530us) server_negotiation.cc:407] Connection header received
0811 04:51:26.319586 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.319592 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.319832 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.319961 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:26.320562 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.321780 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.323990 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.325059 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.325162 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.329001 (+ 3839us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.329748 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.329855 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":101,"threads_started":1}
I20260811 04:51:26.330045 3215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8b58ba0e814fa6a5b247f1a427d797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:26.332347 2917 tablet_service.cc:1467] Processing CreateTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 (DEFAULT_TABLE table=test-table [id=4550d8dd07714baebef831d4b53dde02]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:26.333221 2917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d8b58ba0e814fa6a5b247f1a427d797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:26.337325 3307 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Bootstrap starting.
I20260811 04:51:26.338660 3308 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Bootstrap starting.
I20260811 04:51:26.339181 3309 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap starting.
I20260811 04:51:26.340832 3307 tablet_bootstrap.cc:654] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:26.340910 3308 tablet_bootstrap.cc:654] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:26.341298 3309 tablet_bootstrap.cc:654] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:26.341698 3307 log.cc:824] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:26.342370 3308 log.cc:824] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:26.342675 3309 log.cc:824] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:26.343652 3307 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: No bootstrap required, opened a new log
I20260811 04:51:26.343849 3307 ts_tablet_manager.cc:1397] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 04:51:26.344174 3308 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: No bootstrap required, opened a new log
I20260811 04:51:26.344362 3308 ts_tablet_manager.cc:1397] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.003s
I20260811 04:51:26.347184 3309 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: No bootstrap required, opened a new log
I20260811 04:51:26.347417 3309 ts_tablet_manager.cc:1397] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 04:51:26.347625 3307 raft_consensus.cc:348] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.347879 3307 raft_consensus.cc:374] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:26.347954 3307 raft_consensus.cc:729] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c7af7dbe3f40c78d3d613048ccf89d, State: Initialized, Role: FOLLOWER
I20260811 04:51:26.347779 3308 raft_consensus.cc:348] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.348026 3308 raft_consensus.cc:374] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:26.348099 3308 raft_consensus.cc:729] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c8917e8262d4bd680a1f15fb82b5201, State: Initialized, Role: FOLLOWER
I20260811 04:51:26.348453 3307 consensus_queue.cc:260] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.348520 3308 consensus_queue.cc:260] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.349123 3137 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
I20260811 04:51:26.349483 3307 ts_tablet_manager.cc:1428] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:51:26.349534 3308 ts_tablet_manager.cc:1428] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Time spent starting tablet: real 0.005s user 0.004s sys 0.002s
I20260811 04:51:26.349923 3288 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
I20260811 04:51:26.351264 3309 raft_consensus.cc:348] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.351519 3309 raft_consensus.cc:374] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:26.351619 3309 raft_consensus.cc:729] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c652ff2c26e4cfd95a903a65f97f6ac, State: Initialized, Role: FOLLOWER
I20260811 04:51:26.352123 3309 consensus_queue.cc:260] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.352769 2990 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
I20260811 04:51:26.353152 3309 ts_tablet_manager.cc:1428] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:51:26.390954 3315 raft_consensus.cc:482] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:26.391263 3315 raft_consensus.cc:504] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.392482 3315 leader_election.cc:288] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:26.396780 3302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.392950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:39365 (local address 127.17.188.65:37947)
0811 04:51:26.393083 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.393088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.393110 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:51:26.393194 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.393198 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.393252 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.393353 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:26.393743 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.394420 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.395664 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.396189 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.396314 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.396370 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.396559 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.396638 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:51:26.396797 3290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.392787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.17.188.67:39365)
0811 04:51:26.392900 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.392918 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.393053 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.393374 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.393376 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.393395 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:26.393602 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.393609 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.394538 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.394556 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.395532 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.395541 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.396314 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.396318 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.396422 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.396444 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.396542 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.396643 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":3}
I20260811 04:51:26.396803 3306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.392949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:58511 (local address 127.17.188.66:41849)
0811 04:51:26.393083 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.393096 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.393484 (+ 388us) server_negotiation.cc:407] Connection header received
0811 04:51:26.393627 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.393633 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.393696 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.393771 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:26.394018 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.394718 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.395765 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.396235 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.396362 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.396416 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.396595 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.396671 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:51:26.396842 3317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.392787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41849 (local address 127.17.188.67:58511)
0811 04:51:26.393377 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.393392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:26.393502 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:26.393776 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:26.393779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:26.393793 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:26.393904 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.393909 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.394809 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.394815 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.395628 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:26.395645 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.396355 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.396359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:26.396464 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.396491 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 04:51:26.396579 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 04:51:26.396683 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"mutex_wait_us":148,"thread_start_us":215,"threads_started":1}
I20260811 04:51:26.397541 2938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d8b58ba0e814fa6a5b247f1a427d797" candidate_uuid: "2c8917e8262d4bd680a1f15fb82b5201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" is_pre_election: true
I20260811 04:51:26.397671 3086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d8b58ba0e814fa6a5b247f1a427d797" candidate_uuid: "2c8917e8262d4bd680a1f15fb82b5201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" is_pre_election: true
I20260811 04:51:26.397936 2938 raft_consensus.cc:2454] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c8917e8262d4bd680a1f15fb82b5201 in term 0.
I20260811 04:51:26.397998 3086 raft_consensus.cc:2454] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c8917e8262d4bd680a1f15fb82b5201 in term 0.
I20260811 04:51:26.398427 3165 leader_election.cc:302] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c8917e8262d4bd680a1f15fb82b5201, 8c652ff2c26e4cfd95a903a65f97f6ac; no voters:
I20260811 04:51:26.398713 3315 raft_consensus.cc:2781] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:51:26.398814 3315 raft_consensus.cc:482] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:51:26.398873 3315 raft_consensus.cc:3037] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:26.399989 3315 raft_consensus.cc:504] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.400372 3315 leader_election.cc:288] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [CANDIDATE]: Term 1 election: Requested vote from peers 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:26.400709 2938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d8b58ba0e814fa6a5b247f1a427d797" candidate_uuid: "2c8917e8262d4bd680a1f15fb82b5201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
I20260811 04:51:26.400715 3086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d8b58ba0e814fa6a5b247f1a427d797" candidate_uuid: "2c8917e8262d4bd680a1f15fb82b5201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
I20260811 04:51:26.400851 2938 raft_consensus.cc:3037] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:26.400853 3086 raft_consensus.cc:3037] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:26.401980 2938 raft_consensus.cc:2454] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c8917e8262d4bd680a1f15fb82b5201 in term 1.
I20260811 04:51:26.402035 3086 raft_consensus.cc:2454] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c8917e8262d4bd680a1f15fb82b5201 in term 1.
I20260811 04:51:26.402307 3165 leader_election.cc:302] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c8917e8262d4bd680a1f15fb82b5201, 8c652ff2c26e4cfd95a903a65f97f6ac; no voters:
I20260811 04:51:26.402485 3315 raft_consensus.cc:2781] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:26.402711 3315 raft_consensus.cc:686] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 LEADER]: Becoming Leader. State: Replica: 2c8917e8262d4bd680a1f15fb82b5201, State: Running, Role: LEADER
I20260811 04:51:26.403040 3315 consensus_queue.cc:237] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:26.406497 2774 catalog_manager.cc:5495] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67). New cstate: current_term: 1 leader_uuid: "2c8917e8262d4bd680a1f15fb82b5201" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } health_report { overall_health: UNKNOWN } } }
I20260811 04:51:26.422618 3305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.418944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43368 (local address 127.17.188.67:43347)
0811 04:51:26.419091 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:26.419096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:26.419110 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:51:26.419280 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:26.419283 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:26.419335 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:26.419445 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:26.419700 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.420210 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.421077 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:26.421305 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:26.421415 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:26.421777 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:26.422177 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:51:26.422308 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:26.422370 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 04:51:26.422446 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:51:26.428494 2938 raft_consensus.cc:1261] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Refusing update from remote peer 2c8917e8262d4bd680a1f15fb82b5201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:26.428491 3086 raft_consensus.cc:1261] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Refusing update from remote peer 2c8917e8262d4bd680a1f15fb82b5201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:26.429253 3315 consensus_queue.cc:1035] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:26.429472 3319 consensus_queue.cc:1035] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:26.445997 2773 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:26.446197 2773 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:26.448751 2773 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Sending DeleteTablet for 3 replicas of tablet 9d8b58ba0e814fa6a5b247f1a427d797
I20260811 04:51:26.449600 3215 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:43360
I20260811 04:51:26.449627 2917 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:40814
I20260811 04:51:26.449836 3065 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:36714
I20260811 04:51:26.450305 3334 tablet_replica.cc:330] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: stopping tablet replica
I20260811 04:51:26.450376 3333 tablet_replica.cc:330] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: stopping tablet replica
I20260811 04:51:26.450498 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2846
I20260811 04:51:26.450763 3333 raft_consensus.cc:2229] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:26.452316 3334 raft_consensus.cc:2229] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:51:26.452733 3334 raft_consensus.cc:2258] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:26.453919 3335 tablet_replica.cc:330] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: stopping tablet replica
I20260811 04:51:26.454317 3335 raft_consensus.cc:2229] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:26.454663 3335 raft_consensus.cc:2258] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:26.455929 3334 ts_tablet_manager.cc:1905] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:26.456359 3335 ts_tablet_manager.cc:1905] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:26.458854 3334 ts_tablet_manager.cc:1918] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:26.459043 3334 log.cc:1196] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9d8b58ba0e814fa6a5b247f1a427d797
I20260811 04:51:26.459471 3334 ts_tablet_manager.cc:1939] T 9d8b58ba0e814fa6a5b247f1a427d797 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting consensus metadata
I20260811 04:51:26.459980 3335 ts_tablet_manager.cc:1918] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:26.460167 3335 log.cc:1196] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9d8b58ba0e814fa6a5b247f1a427d797
I20260811 04:51:26.460585 3335 ts_tablet_manager.cc:1939] T 9d8b58ba0e814fa6a5b247f1a427d797 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting consensus metadata
I20260811 04:51:26.461061 2757 catalog_manager.cc:4841] TS 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): tablet 9d8b58ba0e814fa6a5b247f1a427d797 (table test-table [id=4550d8dd07714baebef831d4b53dde02]) successfully deleted
W20260811 04:51:26.461150 2756 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:37947 (error 108)
I20260811 04:51:26.461859 2753 catalog_manager.cc:4841] TS 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): tablet 9d8b58ba0e814fa6a5b247f1a427d797 (table test-table [id=4550d8dd07714baebef831d4b53dde02]) successfully deleted
I20260811 04:51:26.462040 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2995
I20260811 04:51:26.462301 3301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:26.461913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.0.0.1:40822)
0811 04:51:26.462113 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:26.462194 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260811 04:51:26.463209 2756 catalog_manager.cc:4584] TS 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9d8b58ba0e814fa6a5b247f1a427d797: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37947: connect: Connection refused (error 111)
I20260811 04:51:26.472191 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 3142
I20260811 04:51:26.479539 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 2735
I20260811 04:51:46.488561 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--webserver_interface=127.17.188.126
--webserver_port=35649
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:43401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:51:46.607187 3337 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:46.607528 3337 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:46.607645 3337 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:46.612376 3337 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 04:51:46.612478 3337 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 04:51:46.612507 3337 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 04:51:46.612529 3337 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:51:46.612589 3337 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:46.612630 3337 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:46.612665 3337 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:51:46.612701 3337 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:51:46.618434 3337 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:43401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=35649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3337
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:46.619613 3337 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:46.620695 3337 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:46.634967 3345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:46.635006 3347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:46.635042 3344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:46.635268 3337 server_base.cc:1034] running on GCE node
I20260811 04:51:46.636039 3337 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:46.637318 3337 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:46.638517 3337 hybrid_clock.cc:648] HybridClock initialized: now 1786423906638494 us; error 45 us; skew 500 ppm
Aug 11 04:51:46 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423906, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:46.641495 3337 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:51:46.642498 3337 webserver.cc:460] Webserver started at http://127.17.188.126:35649/ using document root <none> and password file <none>
I20260811 04:51:46.643141 3337 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:46.643244 3337 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:46.647630 3337 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:51:46.650089 3354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:46.651417 3337 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:51:46.651568 3337 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "70264a025c644ede8d4fc64437883c69"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "fdec6f9da8ad17415e7f6e3866904656"
server_key_iv: "fc73ab13e09043dcc9fc6d4efe8eb549"
server_key_version: "encryptionkey@0"
I20260811 04:51:46.652240 3337 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:46.683746 3337 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:46.687454 3337 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:46.687668 3337 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:46.695309 3337 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:43401
I20260811 04:51:46.695672 3412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:43401 every 8 connection(s)
I20260811 04:51:46.696529 3337 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:51:46.697244 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3337
I20260811 04:51:46.697762 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:37947
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=33707
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:46.701933 3413 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:51:46.704598 3413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap starting.
I20260811 04:51:46.728922 3413 log.cc:824] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:46.740227 3413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:46.740746 3413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap complete.
I20260811 04:51:46.745438 3413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:46.745958 3413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Initialized, Role: FOLLOWER
I20260811 04:51:46.746522 3413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:46.746673 3413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:51:46.746774 3413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:51:46.746899 3413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 1 FOLLOWER]: Advancing to term 2
I20260811 04:51:46.748955 3413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:46.749330 3413 leader_election.cc:302] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70264a025c644ede8d4fc64437883c69; no voters:
I20260811 04:51:46.749725 3413 leader_election.cc:288] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 04:51:46.749895 3418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 04:51:46.750160 3418 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 LEADER]: Becoming Leader. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Running, Role: LEADER
I20260811 04:51:46.750555 3418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:51:46.750998 3413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:51:46.751621 3418 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70264a025c644ede8d4fc64437883c69. Latest consensus state: current_term: 2 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:51:46.751763 3418 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:46.752249 3419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:51:46.752310 3425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:51:46.752451 3419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
I20260811 04:51:46.757663 3425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:51:46.758412 3425 catalog_manager.cc:1259] Loaded cluster ID: 7c0163f222464237a61eb2a5b24d9e20
I20260811 04:51:46.758482 3425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:51:46.761334 3425 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:51:46.762125 3425 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Loaded TSK: 0
I20260811 04:51:46.779076 3425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Generated new TSK 1
I20260811 04:51:46.779367 3425 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:51:46.835244 3415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:46.835481 3415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:46.835547 3415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:46.839495 3415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:46.839552 3415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:46.839605 3415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:51:46.844827 3415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:37947
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=33707
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:46.845903 3415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:46.846943 3415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:46.857347 3445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:46.857514 3415 server_base.cc:1034] running on GCE node
W20260811 04:51:46.857751 3444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:46.857360 3448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:46.858266 3415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:46.858897 3415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:46.860093 3415 hybrid_clock.cc:648] HybridClock initialized: now 1786423906860055 us; error 56 us; skew 500 ppm
Aug 11 04:51:46 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423906, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:46.862987 3415 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:51:46.863979 3415 webserver.cc:460] Webserver started at http://127.17.188.65:33707/ using document root <none> and password file <none>
I20260811 04:51:46.864549 3415 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:46.864661 3415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:46.868669 3415 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 04:51:46.870899 3456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:46.872215 3415 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:46.872356 3415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "cc7d16ac755daf7a7351568e905b3ed5"
server_key_iv: "b5e1bea79c33f0682223fd45d762cd15"
server_key_version: "encryptionkey@0"
I20260811 04:51:46.872926 3415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:46.890731 3415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:46.894166 3415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:46.894373 3415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:46.895150 3415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:46.896423 3463 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 04:51:46.900415 3415 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 04:51:46.900490 3415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.001s sys 0.000s
I20260811 04:51:46.900594 3415 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 04:51:46.902205 3415 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 04:51:46.902274 3415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:46.902570 3463 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap starting.
I20260811 04:51:46.913087 3415 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37947
I20260811 04:51:46.913199 3591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37947 every 8 connection(s)
I20260811 04:51:46.914150 3415 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:51:46.917470 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3415
I20260811 04:51:46.918179 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:41849
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=45997
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:51:46.923236 3463 log.cc:824] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Log is configured to *not* fsync() on all Append() calls
Aug 11 04:51:46 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423906, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:46.931222 3463 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:51:46.931721 3463 tablet_bootstrap.cc:492] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap complete.
I20260811 04:51:46.933123 3463 ts_tablet_manager.cc:1397] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent bootstrapping tablet: real 0.031s user 0.016s sys 0.013s
I20260811 04:51:46.934249 3594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:46.916443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:37913)
0811 04:51:46.916912 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:46.916965 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:46.917892 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:46.919159 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:46.919167 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:46.919625 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:46.920081 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:46.920095 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.922130 (+ 2035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.922134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:46.923494 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:46.923509 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.924578 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.924582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:46.924770 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:46.925498 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:46.925518 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:46.927592 (+ 2074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:46.930586 (+ 2994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:46.930591 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:46.930604 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:46.930953 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:46.931479 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:46.931484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:46.931489 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:46.931669 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:46.932443 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:46.932452 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:46.932746 (+ 294us) client_negotiation.cc:769] Sending connection context
0811 04:51:46.932947 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 04:51:46.933315 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":140,"threads_started":1}
I20260811 04:51:46.934485 3595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:46.916490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:37913 (local address 127.17.188.126:43401)
0811 04:51:46.917053 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:46.917079 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:46.917148 (+ 69us) server_negotiation.cc:407] Connection header received
0811 04:51:46.918409 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:46.918429 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:46.918772 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:46.919110 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:46.920328 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.921965 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.923643 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.924415 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.924634 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:46.927861 (+ 3227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:46.927872 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:46.927893 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:46.927935 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:46.930445 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:46.931107 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:46.931116 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:46.931125 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:46.931295 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:46.931786 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:46.931792 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:46.931796 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:46.932304 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:46.932465 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:46.933108 (+ 643us) server_negotiation.cc:299] Negotiation successful
0811 04:51:46.933444 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":164,"threads_started":1}
I20260811 04:51:46.936214 3463 raft_consensus.cc:348] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:46.936672 3463 raft_consensus.cc:729] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c652ff2c26e4cfd95a903a65f97f6ac, State: Initialized, Role: FOLLOWER
I20260811 04:51:46.937206 3463 consensus_queue.cc:260] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } } peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } }
I20260811 04:51:46.937662 3592 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:46.937898 3592 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:46.938274 3463 ts_tablet_manager.cc:1428] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260811 04:51:46.938431 3592 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
I20260811 04:51:46.941200 3373 ts_manager.cc:194] Registered new tserver with Master: 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947)
I20260811 04:51:46.945216 3373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:37913
I20260811 04:51:46.948088 3592 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
Aug 11 04:51:46 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423906, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.65@KRBTEST.COM
I20260811 04:51:46.955494 3601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:46.944622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42584 (local address 127.17.188.65:37947)
0811 04:51:46.945019 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:46.945030 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:46.945628 (+ 598us) server_negotiation.cc:407] Connection header received
0811 04:51:46.945701 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:46.945705 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:46.945918 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:46.946083 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:46.946808 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.947537 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.948482 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.948910 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.949031 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:46.951633 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:46.951643 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:46.951653 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:46.951696 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:46.953524 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:46.954109 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:46.954114 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:46.954115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:46.954196 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:46.954482 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:46.954484 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:46.954485 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:46.954730 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:46.954841 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:46.955225 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 04:51:46.955365 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":86,"threads_started":1}
I20260811 04:51:46.955523 3599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:46.944565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.0.0.1:42584)
0811 04:51:46.945264 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:46.945302 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:46.945469 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:46.946207 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:46.946214 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:46.946561 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:46.946663 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:46.946670 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.947657 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.947662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:46.948360 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:46.948370 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:46.949034 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:46.949038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:46.949155 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:46.949775 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:46.949789 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:46.951465 (+ 1676us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:46.953682 (+ 2217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:46.953692 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:46.953698 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:46.953999 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:46.954288 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:46.954292 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:46.954293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:46.954391 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:46.954845 (+ 454us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:46.954852 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:46.955002 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 04:51:46.955152 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 04:51:46.955352 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":125,"threads_started":1}
I20260811 04:51:46.956918 3512 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d8b58ba0e814fa6a5b247f1a427d797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:42584
I20260811 04:51:46.957981 3602 tablet_replica.cc:330] stopping tablet replica
I20260811 04:51:46.958292 3602 raft_consensus.cc:2229] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:46.958561 3602 raft_consensus.cc:2258] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:46.959584 3602 ts_tablet_manager.cc:1905] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:46.963479 3602 ts_tablet_manager.cc:1918] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:46.963603 3602 log.cc:1196] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal/wals/9d8b58ba0e814fa6a5b247f1a427d797
I20260811 04:51:46.963893 3602 ts_tablet_manager.cc:1939] T 9d8b58ba0e814fa6a5b247f1a427d797 P 8c652ff2c26e4cfd95a903a65f97f6ac: Deleting consensus metadata
I20260811 04:51:46.965708 3357 catalog_manager.cc:4841] TS 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947): tablet 9d8b58ba0e814fa6a5b247f1a427d797 (table test-table [id=4550d8dd07714baebef831d4b53dde02]) successfully deleted
W20260811 04:51:47.046505 3596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:47.046782 3596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:47.046828 3596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:47.050839 3596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:47.050901 3596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:47.050961 3596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:51:47.056756 3596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:41849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=45997
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3596
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:47.057915 3596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:47.058907 3596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:47.068804 3613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:47.068794 3608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:47.068790 3610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:47.069226 3596 server_base.cc:1034] running on GCE node
I20260811 04:51:47.074191 3596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:47.075163 3596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:47.076381 3596 hybrid_clock.cc:648] HybridClock initialized: now 1786423907076349 us; error 52 us; skew 500 ppm
Aug 11 04:51:47 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423907, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:47.079715 3596 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:51:47.080708 3596 webserver.cc:460] Webserver started at http://127.17.188.66:45997/ using document root <none> and password file <none>
I20260811 04:51:47.081317 3596 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:47.081421 3596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:47.085510 3596 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260811 04:51:47.087711 3621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.089042 3596 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 04:51:47.089190 3596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "340fb73aae1cb0e6424d05866fd83c52"
server_key_iv: "2864fd19fd5dfd573043421f9f336723"
server_key_version: "encryptionkey@0"
I20260811 04:51:47.089860 3596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:47.101526 3596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:47.104349 3596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:47.104566 3596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:47.105168 3596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:47.106050 3596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:47.106122 3596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.106199 3596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:47.106257 3596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.115430 3596 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:41849
I20260811 04:51:47.115456 3743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:41849 every 8 connection(s)
I20260811 04:51:47.116530 3596 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:51:47.118700 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3596
I20260811 04:51:47.119225 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:43347
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=36217
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 04:51:47 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423907, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:47.132038 3595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.118428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:51389 (local address 127.17.188.126:43401)
0811 04:51:47.118582 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.118586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.119686 (+ 1100us) server_negotiation.cc:407] Connection header received
0811 04:51:47.121148 (+ 1462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.121151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.121213 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.121324 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:47.122600 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.123474 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.124750 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.125218 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.125347 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.127832 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:47.127839 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:47.127843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:47.127882 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:47.129745 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.130287 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.130292 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.130296 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.130402 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.130740 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.130744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.130747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.131032 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:47.131152 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.131612 (+ 460us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.131781 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:51:47.132613 3746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.118915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:51389)
0811 04:51:47.119521 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.119571 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.120922 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.121514 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.121522 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.121942 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:47.122410 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.122424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.123634 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.123637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.124605 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.124616 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.125363 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.125365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.125501 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.126183 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:47.126200 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:47.127635 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:47.129873 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:47.129878 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:47.129890 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:47.130162 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:47.130503 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:47.130505 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:47.130507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:47.130637 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:47.131144 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:47.131149 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:47.131366 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.131519 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.131771 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":152,"threads_started":1}
I20260811 04:51:47.133913 3744 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:47.134162 3744 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:47.134711 3744 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
I20260811 04:51:47.135865 3373 ts_manager.cc:194] Registered new tserver with Master: 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:47.136435 3373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:51389
W20260811 04:51:47.239248 3747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:51:47.239552 3747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:51:47.239598 3747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:51:47.243866 3747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:51:47.243937 3747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:51:47.244027 3747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:51:47.249492 3747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:43347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=36217
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:51:47.250710 3747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:51:47.251857 3747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:51:47.261735 3752 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:51:47.261837 3753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:47.261907 3747 server_base.cc:1034] running on GCE node
W20260811 04:51:47.261729 3756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:51:47.262518 3747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:51:47.263177 3747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:51:47.264345 3747 hybrid_clock.cc:648] HybridClock initialized: now 1786423907264330 us; error 26 us; skew 500 ppm
Aug 11 04:51:47 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423907, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:51:47.267288 3747 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:51:47.268136 3747 webserver.cc:460] Webserver started at http://127.17.188.67:36217/ using document root <none> and password file <none>
I20260811 04:51:47.268672 3747 fs_manager.cc:359] Metadata directory not provided
I20260811 04:51:47.268752 3747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:51:47.272677 3747 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:51:47.274772 3764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.276057 3747 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:51:47.276153 3747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "2c8917e8262d4bd680a1f15fb82b5201"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "ef1a7c80c1097fee8bfb1c7a7ea4756a"
server_key_iv: "e566c7b108c3e9ebd390823822cb6e74"
server_key_version: "encryptionkey@0"
I20260811 04:51:47.276808 3747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:51:47.288928 3747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:51:47.292449 3747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:51:47.292619 3747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:51:47.293296 3747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:51:47.294245 3747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:51:47.294296 3747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.294338 3747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:51:47.294359 3747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:51:47.303687 3747 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43347
I20260811 04:51:47.303714 3889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43347 every 8 connection(s)
I20260811 04:51:47.304767 3747 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:51:47.307516 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3747
Aug 11 04:51:47 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423907, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:51:47.317147 3893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.308146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57682 (local address 127.17.188.126:43401)
0811 04:51:47.308378 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.308382 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.308551 (+ 169us) server_negotiation.cc:407] Connection header received
0811 04:51:47.308652 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.308656 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.308719 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.308850 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:47.309635 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.310473 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.311405 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.311635 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.311712 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.313351 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:47.313354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:47.313356 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:47.313380 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:47.315255 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.315752 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.315755 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.315756 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.315834 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.316139 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.316144 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.316147 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.316369 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:47.316596 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.316762 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.316901 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":85,"threads_started":1}
I20260811 04:51:47.320673 3595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.306719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:49655 (local address 127.17.188.126:43401)
0811 04:51:47.306877 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.306881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.307841 (+ 960us) server_negotiation.cc:407] Connection header received
0811 04:51:47.309741 (+ 1900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.309744 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.309795 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.309853 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:47.311243 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.311880 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.313012 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.313379 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.313458 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.316807 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:47.316811 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:47.316813 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:47.316834 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:47.318537 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.319093 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.319097 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.319099 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.319182 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.319544 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.319548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.319550 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.319736 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:47.319847 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.320391 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.320517 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:51:47.321556 3892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.307077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:49655)
0811 04:51:47.307668 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.307727 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.309471 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.310047 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.310057 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.310569 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:51:47.311095 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.311108 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.312010 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.312013 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.312879 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.312887 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.313532 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.313539 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.313799 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.314336 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:51:47.314356 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:51:47.316620 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:51:47.318651 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:47.318658 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:47.318676 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:47.319009 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:47.319290 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:51:47.319293 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:51:47.319295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:51:47.319445 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:51:47.319847 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:51:47.319856 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:51:47.320132 (+ 276us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.320332 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.320692 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":166,"threads_started":1}
I20260811 04:51:47.322811 3890 heartbeater.cc:347] Connected to a master server at 127.17.188.126:43401
I20260811 04:51:47.323096 3890 heartbeater.cc:464] Registering TS with master...
I20260811 04:51:47.323644 3890 heartbeater.cc:511] Master 127.17.188.126:43401 requested a full tablet report, sending...
I20260811 04:51:47.324756 3373 ts_manager.cc:194] Registered new tserver with Master: 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347)
I20260811 04:51:47.325357 3373 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:49655
I20260811 04:51:47.331073 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:51:47.335399 3595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.331751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.17.188.126:43401)
0811 04:51:47.331894 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.331899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.332141 (+ 242us) server_negotiation.cc:407] Connection header received
0811 04:51:47.332256 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.332258 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.332362 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.332459 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:47.332668 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.333182 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.334206 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.334426 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.334503 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.334844 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:47.334992 (+ 148us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 04:51:47.335232 (+ 240us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57696: token expired
Metrics: {"server-negotiator.queue_time_us":50}
W20260811 04:51:47.335491 3595 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57696: token expired
W20260811 04:51:47.335865 3292 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.17.188.126:43401)
I20260811 04:51:47.343340 3595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.336340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57704 (local address 127.17.188.126:43401)
0811 04:51:47.336462 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.336465 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.336480 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:51:47.336580 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.336582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.336628 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.336692 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:51:47.337307 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.337912 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.338672 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.338875 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.338954 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.340340 (+ 1386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:51:47.340343 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:51:47.340345 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:51:47.340367 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:51:47.341744 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.342165 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.342168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.342169 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.342256 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:51:47.342507 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:51:47.342509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:51:47.342510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:51:47.342699 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:51:47.342806 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.343006 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.343107 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:51:47.345956 3373 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57704:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:51:47.349291 3373 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:51:47.358086 3512 tablet_service.cc:1467] Processing CreateTablet for tablet e2a5766ea6b54e86b07964b2c4ffb635 (DEFAULT_TABLE table=test-table [id=395727b1cfdc4a429ce99d95f3eba9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:47.358834 3512 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a5766ea6b54e86b07964b2c4ffb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:47.361811 3463 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap starting.
I20260811 04:51:47.362730 3599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.356911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43347 (local address 127.0.0.1:38198)
0811 04:51:47.357071 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.357089 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.357183 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.358526 (+ 1343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.358529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.358547 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.358670 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.358677 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.360066 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.360071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.361074 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.361085 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.362220 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.362223 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.362331 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.362381 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.362464 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.362556 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 04:51:47.362762 3463 tablet_bootstrap.cc:654] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:47.362805 3901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.357310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38198 (local address 127.17.188.67:43347)
0811 04:51:47.358039 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.358048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.358070 (+ 22us) server_negotiation.cc:407] Connection header received
0811 04:51:47.358138 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.358144 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.358380 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.358550 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.358905 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.359941 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.361214 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.362095 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.362216 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.362388 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.362494 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.362614 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":130,"threads_started":1}
I20260811 04:51:47.363901 3900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.357106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41849 (local address 127.0.0.1:37622)
0811 04:51:47.357403 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.357417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.357506 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.359224 (+ 1718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.359229 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.359247 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.359335 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.359341 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.360688 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.360692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.362514 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.362524 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.363480 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.363483 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.363580 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.363602 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.363688 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.363767 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":144,"threads_started":1}
I20260811 04:51:47.363965 3902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.357633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37622 (local address 127.17.188.66:41849)
0811 04:51:47.358014 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.358027 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.358054 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:51:47.358142 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.358147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.358382 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.358716 (+ 334us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.359481 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.360554 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.362655 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.363347 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.363479 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.363626 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.363720 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.363818 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":138,"threads_started":1}
I20260811 04:51:47.365315 3463 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: No bootstrap required, opened a new log
I20260811 04:51:47.365439 3463 ts_tablet_manager.cc:1397] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 04:51:47.365988 3463 raft_consensus.cc:348] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.366117 3463 raft_consensus.cc:374] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:47.366165 3463 raft_consensus.cc:729] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c652ff2c26e4cfd95a903a65f97f6ac, State: Initialized, Role: FOLLOWER
I20260811 04:51:47.366353 3463 consensus_queue.cc:260] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.366657 3463 ts_tablet_manager.cc:1428] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 04:51:47.366539 3673 tablet_service.cc:1467] Processing CreateTablet for tablet e2a5766ea6b54e86b07964b2c4ffb635 (DEFAULT_TABLE table=test-table [id=395727b1cfdc4a429ce99d95f3eba9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:47.366541 3816 tablet_service.cc:1467] Processing CreateTablet for tablet e2a5766ea6b54e86b07964b2c4ffb635 (DEFAULT_TABLE table=test-table [id=395727b1cfdc4a429ce99d95f3eba9f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:51:47.367738 3816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a5766ea6b54e86b07964b2c4ffb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:47.367730 3673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e2a5766ea6b54e86b07964b2c4ffb635. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:51:47.376667 3904 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Bootstrap starting.
I20260811 04:51:47.379446 3904 tablet_bootstrap.cc:654] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:47.379925 3905 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Bootstrap starting.
I20260811 04:51:47.380420 3904 log.cc:824] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:47.382630 3904 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: No bootstrap required, opened a new log
I20260811 04:51:47.382737 3905 tablet_bootstrap.cc:654] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Neither blocks nor log segments found. Creating new log.
I20260811 04:51:47.382859 3904 ts_tablet_manager.cc:1397] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 04:51:47.383560 3905 log.cc:824] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Log is configured to *not* fsync() on all Append() calls
I20260811 04:51:47.385448 3905 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: No bootstrap required, opened a new log
I20260811 04:51:47.385695 3905 ts_tablet_manager.cc:1397] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:51:47.385974 3904 raft_consensus.cc:348] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.386220 3904 raft_consensus.cc:374] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:47.386288 3904 raft_consensus.cc:729] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56c7af7dbe3f40c78d3d613048ccf89d, State: Initialized, Role: FOLLOWER
I20260811 04:51:47.386749 3904 consensus_queue.cc:260] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.387811 3904 ts_tablet_manager.cc:1428] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:51:47.387964 3744 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
I20260811 04:51:47.389562 3905 raft_consensus.cc:348] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.389894 3905 raft_consensus.cc:374] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:51:47.389963 3905 raft_consensus.cc:729] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c8917e8262d4bd680a1f15fb82b5201, State: Initialized, Role: FOLLOWER
I20260811 04:51:47.390434 3905 consensus_queue.cc:260] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.391184 3890 heartbeater.cc:503] Master 127.17.188.126:43401 was elected leader, sending a full tablet report...
I20260811 04:51:47.391506 3905 ts_tablet_manager.cc:1428] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
W20260811 04:51:47.415390 3593 tablet.cc:2369] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:51:47.555898 3891 tablet.cc:2369] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:51:47.617758 3745 tablet.cc:2369] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:51:47.679546 3598 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:47.679800 3598 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.681262 3598 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:47.685475 3902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.681784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:42845 (local address 127.17.188.66:41849)
0811 04:51:47.681909 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.681915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.682124 (+ 209us) server_negotiation.cc:407] Connection header received
0811 04:51:47.682265 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.682271 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.682328 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.682400 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.682757 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.683285 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.684500 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.684892 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.685025 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.685076 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.685276 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.685348 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:51:47.685495 3911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.681504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43347 (local address 127.17.188.65:37495)
0811 04:51:47.681908 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.681926 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.682130 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.682504 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.682507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.682525 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.682663 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.682668 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.683404 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.683407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.684340 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.684350 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.685009 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.685013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.685103 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.685158 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.685253 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.685335 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":69,"thread_start_us":133,"threads_started":1}
I20260811 04:51:47.685496 3901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.681601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:37495 (local address 127.17.188.67:43347)
0811 04:51:47.681760 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.681765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.682031 (+ 266us) server_negotiation.cc:407] Connection header received
0811 04:51:47.682322 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.682325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.682366 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.682463 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.682802 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.683274 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.684471 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.684878 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.685006 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.685061 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.685296 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.685368 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 04:51:47.685515 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.681618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41849 (local address 127.17.188.65:42845)
0811 04:51:47.682025 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.682038 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.682135 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.682443 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.682449 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.682472 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.682635 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.682642 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.683400 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.683405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.684344 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.684355 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.685033 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.685036 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.685134 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.685168 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.685261 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.685343 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":346,"mutex_wait_us":91,"thread_start_us":71,"threads_started":1}
I20260811 04:51:47.686203 3908 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:51:47.686220 3838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c8917e8262d4bd680a1f15fb82b5201" is_pre_election: true
I20260811 04:51:47.686411 3908 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.686440 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" is_pre_election: true
I20260811 04:51:47.686568 3838 raft_consensus.cc:2454] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c652ff2c26e4cfd95a903a65f97f6ac in term 0.
I20260811 04:51:47.686880 3695 raft_consensus.cc:2454] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c652ff2c26e4cfd95a903a65f97f6ac in term 0.
I20260811 04:51:47.687124 3460 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2c8917e8262d4bd680a1f15fb82b5201, 8c652ff2c26e4cfd95a903a65f97f6ac; no voters:
I20260811 04:51:47.687471 3598 raft_consensus.cc:2781] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:51:47.687574 3598 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:51:47.687635 3598 raft_consensus.cc:3037] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:47.687804 3908 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947)
I20260811 04:51:47.689050 3598 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.689414 3598 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 1 election: Requested vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
I20260811 04:51:47.689803 3695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
I20260811 04:51:47.689801 3838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c8917e8262d4bd680a1f15fb82b5201"
I20260811 04:51:47.689910 3695 raft_consensus.cc:3037] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:47.689939 3838 raft_consensus.cc:3037] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:51:47.691082 3695 raft_consensus.cc:2454] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c652ff2c26e4cfd95a903a65f97f6ac in term 1.
I20260811 04:51:47.691398 3838 raft_consensus.cc:2454] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c652ff2c26e4cfd95a903a65f97f6ac in term 1.
I20260811 04:51:47.691480 3457 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 56c7af7dbe3f40c78d3d613048ccf89d, 8c652ff2c26e4cfd95a903a65f97f6ac; no voters:
I20260811 04:51:47.691672 3598 raft_consensus.cc:2781] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:51:47.691880 3598 raft_consensus.cc:686] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 LEADER]: Becoming Leader. State: Replica: 8c652ff2c26e4cfd95a903a65f97f6ac, State: Running, Role: LEADER
I20260811 04:51:47.692160 3598 consensus_queue.cc:237] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:51:47.694043 3912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.687972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.17.188.66:33219)
0811 04:51:47.688220 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.688236 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.688334 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.690125 (+ 1791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.690129 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.690152 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.690301 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.690309 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.691429 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.691433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.692683 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.692692 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.693620 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.693624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.693728 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.693757 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.693820 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.693886 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":94,"threads_started":1}
I20260811 04:51:47.694653 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.688044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:33219 (local address 127.17.188.65:37947)
0811 04:51:47.689739 (+ 1695us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.689743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.689757 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:51:47.689812 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.689818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.689866 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.690427 (+ 561us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.690523 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.691269 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.692840 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.693459 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.694253 (+ 794us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.694379 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.694422 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.694499 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1617,"thread_start_us":85,"threads_started":1}
I20260811 04:51:47.695227 3535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" is_pre_election: true
I20260811 04:51:47.695789 3901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.689630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:59619 (local address 127.17.188.67:43347)
0811 04:51:47.691893 (+ 2263us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.691897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.691911 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:51:47.691950 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.691952 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.691995 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.692065 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:51:47.692428 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.693086 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.694479 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.695095 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.695210 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.695265 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.695607 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.695682 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2183}
I20260811 04:51:47.695783 3914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.687972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43347 (local address 127.17.188.66:59619)
0811 04:51:47.688523 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.688538 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:51:47.688678 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:51:47.692176 (+ 3498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:51:47.692179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:51:47.692195 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:51:47.692306 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.692312 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.693209 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.693212 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.694340 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:51:47.694351 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.695349 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.695356 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:51:47.695458 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.695483 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:51:47.695564 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 04:51:47.695629 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"mutex_wait_us":232,"thread_start_us":102,"threads_started":1}
I20260811 04:51:47.696445 3838 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2a5766ea6b54e86b07964b2c4ffb635" candidate_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c8917e8262d4bd680a1f15fb82b5201" is_pre_election: true
I20260811 04:51:47.696635 3838 raft_consensus.cc:2379] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 56c7af7dbe3f40c78d3d613048ccf89d in current term 1: Already voted for candidate 8c652ff2c26e4cfd95a903a65f97f6ac in this term.
I20260811 04:51:47.697834 3624 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 56c7af7dbe3f40c78d3d613048ccf89d; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 8c652ff2c26e4cfd95a903a65f97f6ac
I20260811 04:51:47.698108 3908 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 04:51:47.698818 3373 catalog_manager.cc:5495] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65). New cstate: current_term: 1 leader_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } health_report { overall_health: HEALTHY } } }
I20260811 04:51:47.728477 3913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.725015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42592 (local address 127.17.188.65:37947)
0811 04:51:47.725168 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:51:47.725171 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:51:47.725187 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:51:47.725270 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:51:47.725273 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:51:47.725338 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:51:47.725430 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:51:47.725671 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.726162 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.726968 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:51:47.727180 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:51:47.727268 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:51:47.727517 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:51:47.727964 (+ 447us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:51:47.728052 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 04:51:47.728203 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 04:51:47.728258 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 04:51:47.732669 3838 raft_consensus.cc:1261] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Refusing update from remote peer 8c652ff2c26e4cfd95a903a65f97f6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:47.732713 3695 raft_consensus.cc:1261] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Refusing update from remote peer 8c652ff2c26e4cfd95a903a65f97f6ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:51:47.733414 3598 consensus_queue.cc:1035] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:47.733695 3916 consensus_queue.cc:1035] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:51:47.742782 3921 mvcc.cc:205] Tried to move back new op lower bound from 7317192326066491392 to 7317192325910020096. Current Snapshot: MvccSnapshot[applied={T|T < 7317192326066491392}]
I20260811 04:51:47.744432 3922 mvcc.cc:205] Tried to move back new op lower bound from 7317192326066491392 to 7317192325910020096. Current Snapshot: MvccSnapshot[applied={T|T < 7317192326066491392}]
I20260811 04:51:47.750447 3371 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:47.750589 3371 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57704:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:51:47.753062 3371 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Sending DeleteTablet for 3 replicas of tablet e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:51:47.753803 3816 tablet_service.cc:1514] Processing DeleteTablet for tablet e2a5766ea6b54e86b07964b2c4ffb635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:47 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:38198
I20260811 04:51:47.753803 3673 tablet_service.cc:1514] Processing DeleteTablet for tablet e2a5766ea6b54e86b07964b2c4ffb635 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:51:47 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:37622
I20260811 04:51:47.754076 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 3415
I20260811 04:51:47.757036 3932 tablet_replica.cc:330] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: stopping tablet replica
I20260811 04:51:47.757381 3932 raft_consensus.cc:2229] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:47.757716 3932 raft_consensus.cc:2258] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:47.758046 3931 tablet_replica.cc:330] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: stopping tablet replica
I20260811 04:51:47.758363 3931 raft_consensus.cc:2229] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:51:47.758673 3931 raft_consensus.cc:2258] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:51:47.759802 3932 ts_tablet_manager.cc:1905] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:47.760239 3931 ts_tablet_manager.cc:1905] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:51:47.762367 3932 ts_tablet_manager.cc:1918] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:47.762487 3932 log.cc:1196] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:51:47.762825 3932 ts_tablet_manager.cc:1939] T e2a5766ea6b54e86b07964b2c4ffb635 P 2c8917e8262d4bd680a1f15fb82b5201: Deleting consensus metadata
I20260811 04:51:47.763780 3931 ts_tablet_manager.cc:1918] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:51:47.763887 3931 log.cc:1196] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:51:47.764034 3359 catalog_manager.cc:4841] TS 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): tablet e2a5766ea6b54e86b07964b2c4ffb635 (table test-table [id=395727b1cfdc4a429ce99d95f3eba9f9]) successfully deleted
I20260811 04:51:47.764631 3931 ts_tablet_manager.cc:1939] T e2a5766ea6b54e86b07964b2c4ffb635 P 56c7af7dbe3f40c78d3d613048ccf89d: Deleting consensus metadata
W20260811 04:51:47.765913 3357 connection.cc:535] client connection to 127.17.188.65:37947 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:51:47.765924 3355 catalog_manager.cc:4841] TS 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): tablet e2a5766ea6b54e86b07964b2c4ffb635 (table test-table [id=395727b1cfdc4a429ce99d95f3eba9f9]) successfully deleted
W20260811 04:51:47.766103 3357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:51:47.766839 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 3596
I20260811 04:51:47.767163 3900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:51:47.766864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:37947 (local address 127.0.0.1:42606)
0811 04:51:47.766998 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 04:51:47.767068 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37947: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 04:51:47.774307 3357 catalog_manager.cc:4584] TS 8c652ff2c26e4cfd95a903a65f97f6ac (127.17.188.65:37947): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e2a5766ea6b54e86b07964b2c4ffb635: Network error: Client connection negotiation failed: client connection to 127.17.188.65:37947: connect: Connection refused (error 111)
I20260811 04:51:47.776796 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 3747
I20260811 04:51:47.783933 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 3337
I20260811 04:52:07.792800 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--webserver_interface=127.17.188.126
--webserver_port=35649
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:43401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:07.907399 3934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:07.907667 3934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:07.907708 3934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:07.911646 3934 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 04:52:07.911692 3934 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 04:52:07.911707 3934 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 04:52:07.911720 3934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:07.911737 3934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:07.911800 3934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:07.911829 3934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:07.911862 3934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:07.917047 3934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:43401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:43401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=35649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3934
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:07.918149 3934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:07.919173 3934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:07.928186 3939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:07.928220 3940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:07.928267 3934 server_base.cc:1034] running on GCE node
W20260811 04:52:07.928220 3942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:07.929024 3934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:07.930188 3934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:07.931368 3934 hybrid_clock.cc:648] HybridClock initialized: now 1786423927931355 us; error 25 us; skew 500 ppm
Aug 11 04:52:07 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423927, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:07.934062 3934 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:07.934948 3934 webserver.cc:460] Webserver started at http://127.17.188.126:35649/ using document root <none> and password file <none>
I20260811 04:52:07.935467 3934 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:07.935523 3934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:07.939297 3934 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:07.941349 3951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:07.942613 3934 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:07.942746 3934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "70264a025c644ede8d4fc64437883c69"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "fdec6f9da8ad17415e7f6e3866904656"
server_key_iv: "fc73ab13e09043dcc9fc6d4efe8eb549"
server_key_version: "encryptionkey@0"
I20260811 04:52:07.943264 3934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:07.963196 3934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:07.966220 3934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:07.966384 3934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:07.973892 3934 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:43401
I20260811 04:52:07.974197 4007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:43401 every 8 connection(s)
I20260811 04:52:07.975098 3934 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:07.979444 4008 sys_catalog.cc:263] Verifying existing consensus state
I20260811 04:52:07.981074 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 3934
I20260811 04:52:07.981348 4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap starting.
I20260811 04:52:07.981601 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:37947
--local_ip_for_outbound_sockets=127.17.188.65
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=33707
--webserver_interface=127.17.188.65
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:52:08.001416 4008 log.cc:824] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:08.012573 4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:52:08.012974 4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Bootstrap complete.
I20260811 04:52:08.017213 4008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:52:08.017665 4008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Initialized, Role: FOLLOWER
I20260811 04:52:08.018170 4008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:52:08.018292 4008 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:08.018378 4008 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:08.018471 4008 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 2 FOLLOWER]: Advancing to term 3
I20260811 04:52:08.020382 4008 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:52:08.020720 4008 leader_election.cc:302] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70264a025c644ede8d4fc64437883c69; no voters:
I20260811 04:52:08.021070 4008 leader_election.cc:288] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 04:52:08.021155 4012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 04:52:08.021387 4012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [term 3 LEADER]: Becoming Leader. State: Replica: 70264a025c644ede8d4fc64437883c69, State: Running, Role: LEADER
I20260811 04:52:08.021730 4012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } }
I20260811 04:52:08.022457 4008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:08.022766 4014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:52:08.022900 4014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:08.023126 4015 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70264a025c644ede8d4fc64437883c69. Latest consensus state: current_term: 3 leader_uuid: "70264a025c644ede8d4fc64437883c69" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70264a025c644ede8d4fc64437883c69" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 43401 } } }
I20260811 04:52:08.023237 4015 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:08.023286 4017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:08.028419 4017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:08.029191 4017 catalog_manager.cc:1259] Loaded cluster ID: 7c0163f222464237a61eb2a5b24d9e20
I20260811 04:52:08.029256 4017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:08.031863 4017 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:08.032611 4017 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Loaded TSK: 0
I20260811 04:52:08.032696 4017 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 70264a025c644ede8d4fc64437883c69: Loaded TSK: 1
F20260811 04:52:08.033479 4017 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2e83c3c9ad google::LogMessage::Fail() at ??:0
@ 0x7f2e83c3f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2e83c3c4de google::LogMessage::Flush() at ??:0
@ 0x7f2e83c3da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2e8690018d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f2e868f8f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f2e8e5a17bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f2e8e57b99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f2e8e57c178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f2e8e5bddf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f2e8e5dc82b std::function<>::operator()() at ??:0
@ 0x7f2e8e57bb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f2e8e57cf3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2e8e579579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f2e8e5bd640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2e85e8e3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2e85e8ec83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f2e85e903f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f2e85e7f512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2e874c36db start_thread at ??:0
@ 0x7f2e8273a61f clone at ??:0
W20260811 04:52:08.121100 4010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:08.121466 4010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:08.121538 4010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:08.128212 4010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:08.128286 4010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:08.128382 4010 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:08.136842 4010 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:37947
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=33707
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:08.138377 4010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:08.139786 4010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:08.151701 4060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:08.151701 4063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:08.151791 4061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:08.151921 4010 server_base.cc:1034] running on GCE node
I20260811 04:52:08.152578 4010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:08.153468 4010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:08.154701 4010 hybrid_clock.cc:648] HybridClock initialized: now 1786423928154659 us; error 43 us; skew 500 ppm
Aug 11 04:52:08 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423928, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:08.158243 4010 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:52:08.159211 4010 webserver.cc:460] Webserver started at http://127.17.188.65:33707/ using document root <none> and password file <none>
I20260811 04:52:08.159832 4010 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:08.159929 4010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:08.164224 4010 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:52:08.166694 4071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.168118 4010 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:08.168280 4010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "8c652ff2c26e4cfd95a903a65f97f6ac"
format_stamp: "Formatted at 2026-08-11 04:51:25 on dist-test-slave-njxd"
server_key: "cc7d16ac755daf7a7351568e905b3ed5"
server_key_iv: "b5e1bea79c33f0682223fd45d762cd15"
server_key_version: "encryptionkey@0"
I20260811 04:52:08.168879 4010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:08.202114 4010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:08.205742 4010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:08.205960 4010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:08.206600 4010 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:08.207787 4081 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 04:52:08.213559 4010 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 04:52:08.213703 4010 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260811 04:52:08.213794 4010 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 04:52:08.215530 4010 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 04:52:08.215605 4010 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 04:52:08.215927 4081 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap starting.
I20260811 04:52:08.226770 4010 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:37947
I20260811 04:52:08.227051 4210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:37947 every 8 connection(s)
I20260811 04:52:08.227854 4010 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:08.230634 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4010
I20260811 04:52:08.231154 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:41849
--local_ip_for_outbound_sockets=127.17.188.66
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=45997
--webserver_interface=127.17.188.66
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:52:08.240892 4081 log.cc:824] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:08.248600 4081 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 04:52:08.249025 4081 tablet_bootstrap.cc:492] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Bootstrap complete.
I20260811 04:52:08.250373 4081 ts_tablet_manager.cc:1397] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent bootstrapping tablet: real 0.035s user 0.019s sys 0.012s
I20260811 04:52:08.252877 4081 raft_consensus.cc:348] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:08.253335 4081 raft_consensus.cc:729] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c652ff2c26e4cfd95a903a65f97f6ac, State: Initialized, Role: FOLLOWER
I20260811 04:52:08.253990 4081 consensus_queue.cc:260] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:08.254992 4081 ts_tablet_manager.cc:1428] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
W20260811 04:52:08.311525 4213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:52:08.229959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:42103)
0811 04:52:08.231449 (+ 1490us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.231524 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:08.232829 (+ 1305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:08.310680 (+ 77851us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":165,"threads_started":1}
W20260811 04:52:08.312168 4211 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:43401 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:43401: Client connection negotiation failed: client connection to 127.17.188.126:43401: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 04:52:08.312956 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.312678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:39777)
0811 04:52:08.312826 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.312898 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 04:52:08.313690 4213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.313454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:48079)
0811 04:52:08.313565 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.313632 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 04:52:08.313930 4211 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 04:52:08.373947 4214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:08.374275 4214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:08.374349 4214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:08.378603 4214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:08.378720 4214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:08.378815 4214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:08.384495 4214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:41849
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=45997
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:08.385768 4214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:08.386847 4214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:08.396663 4222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:08.396875 4214 server_base.cc:1034] running on GCE node
W20260811 04:52:08.396932 4224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:08.396672 4221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:08.397435 4214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:08.398118 4214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:08.399281 4214 hybrid_clock.cc:648] HybridClock initialized: now 1786423928399265 us; error 26 us; skew 500 ppm
Aug 11 04:52:08 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423928, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:08.402064 4214 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:52:08.402997 4214 webserver.cc:460] Webserver started at http://127.17.188.66:45997/ using document root <none> and password file <none>
I20260811 04:52:08.403573 4214 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:08.403637 4214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:08.407482 4214 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 04:52:08.409502 4232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.410763 4214 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:08.410898 4214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "56c7af7dbe3f40c78d3d613048ccf89d"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "340fb73aae1cb0e6424d05866fd83c52"
server_key_iv: "2864fd19fd5dfd573043421f9f336723"
server_key_version: "encryptionkey@0"
I20260811 04:52:08.411444 4214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:08.429924 4214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:08.433092 4214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:08.433316 4214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:08.434031 4214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:08.434902 4214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:08.434975 4214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.435053 4214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:08.435097 4214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.444334 4214 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:41849
I20260811 04:52:08.444365 4361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:41849 every 8 connection(s)
I20260811 04:52:08.445356 4214 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:08.449251 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.447482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:57397)
0811 04:52:08.447952 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.448062 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":129,"threads_started":1}
W20260811 04:52:08.449796 4362 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:43401 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:43401: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
I20260811 04:52:08.450398 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.450183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:48491)
0811 04:52:08.450295 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.450343 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 04:52:08.451079 4364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.450875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:47171)
0811 04:52:08.450979 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.451030 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 04:52:08.451278 4362 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 04:52:08.453656 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4214
I20260811 04:52:08.454145 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:43347
--local_ip_for_outbound_sockets=127.17.188.67
--tserver_master_addrs=127.17.188.126:43401
--webserver_port=36217
--webserver_interface=127.17.188.67
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:08.568452 4365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:08.568785 4365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:08.568889 4365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:08.573115 4365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:08.573199 4365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:08.573297 4365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:08.578819 4365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:43347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=36217
--tserver_master_addrs=127.17.188.126:43401
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:08.579963 4365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:08.581038 4365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:08.590824 4370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:08.590934 4365 server_base.cc:1034] running on GCE node
W20260811 04:52:08.590816 4374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:08.591132 4372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:08.591542 4365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:08.592248 4365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:08.593412 4365 hybrid_clock.cc:648] HybridClock initialized: now 1786423928593383 us; error 43 us; skew 500 ppm
Aug 11 04:52:08 dist-test-slave-njxd krb5kdc[2721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423928, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:08.596413 4365 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:52:08.597420 4365 webserver.cc:460] Webserver started at http://127.17.188.67:36217/ using document root <none> and password file <none>
I20260811 04:52:08.598061 4365 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:08.598126 4365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:08.602011 4365 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 04:52:08.604094 4381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.605362 4365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:08.605491 4365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "2c8917e8262d4bd680a1f15fb82b5201"
format_stamp: "Formatted at 2026-08-11 04:51:26 on dist-test-slave-njxd"
server_key: "ef1a7c80c1097fee8bfb1c7a7ea4756a"
server_key_iv: "e566c7b108c3e9ebd390823822cb6e74"
server_key_version: "encryptionkey@0"
I20260811 04:52:08.606113 4365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:08.623803 4365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:08.626892 4365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:08.627110 4365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:08.627759 4365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:08.628616 4365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:08.628679 4365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.628747 4365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:08.628785 4365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:08.638485 4365 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43347
I20260811 04:52:08.638516 4507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43347 every 8 connection(s)
I20260811 04:52:08.639516 4365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:08.641687 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4365
I20260811 04:52:08.643718 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.641799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:54623)
0811 04:52:08.642316 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.642451 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":142,"threads_started":1}
W20260811 04:52:08.644155 4508 heartbeater.cc:644] Failed to heartbeat to 127.17.188.126:43401 (0 consecutive failures): Network error: Failed to ping master at 127.17.188.126:43401: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
I20260811 04:52:08.644776 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.644541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:32871)
0811 04:52:08.644654 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.644708 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 04:52:08.645341 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:08.645129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:40813)
0811 04:52:08.645237 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:08.645281 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 04:52:08.645556 4508 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 04:52:09.315173 4512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.314621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:34179)
0811 04:52:09.314938 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:09.315005 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":81,"threads_started":1}
I20260811 04:52:09.452296 4513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.451848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:44939)
0811 04:52:09.452124 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:09.452183 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":80,"threads_started":1}
I20260811 04:52:09.646773 4514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.646269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:53399)
0811 04:52:09.646547 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:09.646632 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":96,"threads_started":1}
I20260811 04:52:09.943269 4515 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:09.943506 4515 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:09.944608 4515 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
Aug 11 04:52:09 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423928, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.67@KRBTEST.COM
Aug 11 04:52:09 dist-test-slave-njxd krb5kdc[2721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423928, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.66@KRBTEST.COM
I20260811 04:52:09.961477 4516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.944842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43347 (local address 127.17.188.65:36041)
0811 04:52:09.945171 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:09.945187 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:09.945315 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:09.947409 (+ 2094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:09.947412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:09.948039 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:09.948969 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:09.948992 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.950943 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.950945 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:09.952573 (+ 1628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:09.952585 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.953826 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.953829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:09.953902 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:09.954575 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:09.954591 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:09.956266 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:09.958627 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:09.958634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:09.958649 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:09.959004 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:09.959401 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959403 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:09.959405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:09.959622 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:09.960406 (+ 784us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:09.960412 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:09.960687 (+ 275us) client_negotiation.cc:769] Sending connection context
0811 04:52:09.960873 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 04:52:09.961276 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":310,"spinlock_wait_cycles":7808,"thread_start_us":76,"threads_started":1}
I20260811 04:52:09.961483 4520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.945014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:36361 (local address 127.17.188.66:41849)
0811 04:52:09.945418 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:09.945445 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:09.945490 (+ 45us) server_negotiation.cc:407] Connection header received
0811 04:52:09.946465 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:09.946474 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:09.946940 (+ 466us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:09.947274 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:09.949162 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.950767 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.952700 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.953425 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.953622 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:09.956743 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:09.956749 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:09.956761 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:09.956791 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:09.958964 (+ 2173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959502 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:09.959507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:09.959513 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:09.959684 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959985 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:09.959988 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:09.959989 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:09.960420 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:09.960537 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:09.960991 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 04:52:09.961266 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":88,"threads_started":1}
I20260811 04:52:09.961493 4518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.945014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:36041 (local address 127.17.188.67:43347)
0811 04:52:09.945417 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:09.945445 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:09.945490 (+ 45us) server_negotiation.cc:407] Connection header received
0811 04:52:09.946465 (+ 975us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:09.946474 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:09.946941 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:09.947274 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:09.949162 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.950767 (+ 1605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.952700 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.953425 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.953622 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:09.956538 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:09.956546 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:09.956566 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:09.956605 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:09.958485 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959121 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:09.959127 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:09.959133 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:09.959287 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959752 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:09.959756 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:09.959758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:09.960264 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:09.960364 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:09.960992 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 04:52:09.961287 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":73,"threads_started":1}
I20260811 04:52:09.962260 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:09.944842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41849 (local address 127.17.188.65:36361)
0811 04:52:09.945234 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:09.945248 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:09.945317 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:09.947396 (+ 2079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:09.947402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:09.948039 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:09.948969 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:09.948992 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.950939 (+ 1947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.950942 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:09.952573 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:09.952585 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:09.953599 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:09.953604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:09.953829 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:09.954651 (+ 822us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:09.954664 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:09.956541 (+ 1877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:09.959108 (+ 2567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:09.959114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:09.959384 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:09.959794 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:09.959800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:09.959805 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:09.959892 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:09.960538 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:09.960540 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:09.960674 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 04:52:09.960873 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 04:52:09.961367 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":562,"spinlock_wait_cycles":20224,"thread_start_us":57,"threads_started":1}
W20260811 04:52:09.964171 4078 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
W20260811 04:52:09.964344 4072 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:52:09.964454 4072 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c652ff2c26e4cfd95a903a65f97f6ac; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 56c7af7dbe3f40c78d3d613048ccf89d
I20260811 04:52:09.964761 4515 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:52:10.316321 4517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:10.316036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:56291)
0811 04:52:10.316178 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:10.316234 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 04:52:10.453441 4521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:10.453030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:37183)
0811 04:52:10.453284 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:10.453338 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":83,"threads_started":1}
I20260811 04:52:10.647890 4522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:10.647470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:34087)
0811 04:52:10.647738 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:10.647796 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":77,"threads_started":1}
I20260811 04:52:11.317555 4524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:11.317100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:55597)
0811 04:52:11.317377 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:11.317438 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":87,"threads_started":1}
I20260811 04:52:11.454702 4525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:11.454228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:42117)
0811 04:52:11.454528 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:11.454605 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":99,"threads_started":1}
I20260811 04:52:11.649238 4526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:11.648757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:59885)
0811 04:52:11.649067 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:11.649135 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":102,"threads_started":1}
I20260811 04:52:11.741214 4527 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:11.741387 4527 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:11.741892 4527 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
W20260811 04:52:11.742841 4072 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
W20260811 04:52:11.742935 4078 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:52:11.742980 4072 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c652ff2c26e4cfd95a903a65f97f6ac; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 56c7af7dbe3f40c78d3d613048ccf89d
I20260811 04:52:11.743113 4527 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:52:12.318943 4528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:12.318449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:42109)
0811 04:52:12.318773 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:12.318837 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":108,"threads_started":1}
I20260811 04:52:12.455880 4529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:12.455476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:51799)
0811 04:52:12.455730 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:12.455789 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":77,"threads_started":1}
I20260811 04:52:12.650512 4530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:12.650057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:39047)
0811 04:52:12.650358 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:12.650419 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":83,"threads_started":1}
I20260811 04:52:13.320515 4531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:13.320016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:37007)
0811 04:52:13.320353 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:13.320416 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":81,"threads_started":1}
I20260811 04:52:13.385377 4532 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:13.385551 4532 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:13.386063 4532 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
W20260811 04:52:13.387048 4072 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
W20260811 04:52:13.387212 4078 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:52:13.387311 4078 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c652ff2c26e4cfd95a903a65f97f6ac; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 56c7af7dbe3f40c78d3d613048ccf89d
I20260811 04:52:13.387490 4532 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:52:13.457046 4533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:13.456639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:55633)
0811 04:52:13.456899 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:13.456952 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":92,"threads_started":1}
I20260811 04:52:13.652065 4534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:13.651517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:38683)
0811 04:52:13.651902 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:13.651969 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":85,"threads_started":1}
I20260811 04:52:14.321834 4535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:14.321331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:56935)
0811 04:52:14.321668 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:14.321732 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":81,"threads_started":1}
I20260811 04:52:14.458566 4536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:14.458008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:36713)
0811 04:52:14.458385 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:14.458460 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":115,"threads_started":1}
I20260811 04:52:14.653481 4537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:14.652992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:34567)
0811 04:52:14.653308 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:14.653378 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":86,"threads_started":1}
I20260811 04:52:15.323189 4538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:15.322714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:56071)
0811 04:52:15.323014 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:15.323078 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":97,"threads_started":1}
I20260811 04:52:15.459885 4539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:15.459372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:56351)
0811 04:52:15.459719 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:15.459784 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":79,"threads_started":1}
I20260811 04:52:15.655200 4540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:15.654451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:51821)
0811 04:52:15.654908 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:15.655007 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":115,"threads_started":1}
I20260811 04:52:16.324628 4541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:16.324149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:45813)
0811 04:52:16.324452 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:16.324517 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":85,"threads_started":1}
I20260811 04:52:16.461244 4542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:16.460798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:45595)
0811 04:52:16.461073 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:16.461146 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":82,"threads_started":1}
I20260811 04:52:16.656443 4544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:16.655970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:54617)
0811 04:52:16.656275 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:16.656335 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":102,"threads_started":1}
I20260811 04:52:17.326184 4545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:17.325713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:46081)
0811 04:52:17.326001 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:17.326079 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":84,"threads_started":1}
I20260811 04:52:17.332304 4546 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:17.332444 4546 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:17.333014 4546 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
W20260811 04:52:17.333937 4072 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
W20260811 04:52:17.334108 4078 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:52:17.334205 4078 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c652ff2c26e4cfd95a903a65f97f6ac; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 56c7af7dbe3f40c78d3d613048ccf89d
I20260811 04:52:17.334372 4546 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:52:17.462527 4547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:17.462082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:36571)
0811 04:52:17.462358 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:17.462427 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":80,"threads_started":1}
I20260811 04:52:17.657814 4548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:17.657289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:54143)
0811 04:52:17.657619 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:17.657695 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":107,"threads_started":1}
I20260811 04:52:18.327589 4550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:18.327123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:60093)
0811 04:52:18.327412 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:18.327477 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":97,"threads_started":1}
I20260811 04:52:18.463869 4551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:18.463407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:36325)
0811 04:52:18.463701 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:18.463768 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":75,"threads_started":1}
I20260811 04:52:18.659349 4552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:18.658827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:47775)
0811 04:52:18.659164 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:18.659231 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":103,"threads_started":1}
I20260811 04:52:19.328935 4553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:19.328486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:39569)
0811 04:52:19.328766 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:19.328824 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":79,"threads_started":1}
I20260811 04:52:19.465404 4554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:19.464834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:48327)
0811 04:52:19.465188 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:19.465264 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":108,"threads_started":1}
I20260811 04:52:19.483258 4555 raft_consensus.cc:482] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:19.483420 4555 raft_consensus.cc:504] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2c8917e8262d4bd680a1f15fb82b5201" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43347 } } peers { permanent_uuid: "56c7af7dbe3f40c78d3d613048ccf89d" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41849 } } peers { permanent_uuid: "8c652ff2c26e4cfd95a903a65f97f6ac" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 37947 } }
I20260811 04:52:19.483919 4555 leader_election.cc:288] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347), 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849)
W20260811 04:52:19.484724 4078 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2c8917e8262d4bd680a1f15fb82b5201 (127.17.188.67:43347): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
W20260811 04:52:19.484819 4072 leader_election.cc:341] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 56c7af7dbe3f40c78d3d613048ccf89d (127.17.188.66:41849): Not found: Tablet not found: e2a5766ea6b54e86b07964b2c4ffb635
I20260811 04:52:19.484939 4072 leader_election.cc:302] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c652ff2c26e4cfd95a903a65f97f6ac; no voters: 2c8917e8262d4bd680a1f15fb82b5201, 56c7af7dbe3f40c78d3d613048ccf89d
I20260811 04:52:19.485147 4555 raft_consensus.cc:2726] T e2a5766ea6b54e86b07964b2c4ffb635 P 8c652ff2c26e4cfd95a903a65f97f6ac [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 04:52:19.660732 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:19.660238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:43685)
0811 04:52:19.660520 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:19.660601 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":114,"threads_started":1}
I20260811 04:52:20.330266 4557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:20.329812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:42063)
0811 04:52:20.330099 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:20.330165 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":98,"threads_started":1}
I20260811 04:52:20.466557 4558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:20.466158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:46571)
0811 04:52:20.466407 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:20.466463 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":70,"threads_started":1}
I20260811 04:52:20.661988 4559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:20.661529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:43413)
0811 04:52:20.661829 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:20.661890 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":102,"threads_started":1}
I20260811 04:52:21.331440 4560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:21.331025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:55529)
0811 04:52:21.331289 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:21.331342 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":91,"threads_started":1}
I20260811 04:52:21.467700 4561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:21.467296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:59401)
0811 04:52:21.467532 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:21.467586 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":73,"threads_started":1}
I20260811 04:52:21.663280 4562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:21.662856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:53615)
0811 04:52:21.663126 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:21.663182 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":101,"threads_started":1}
I20260811 04:52:22.332683 4563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:22.332226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:42189)
0811 04:52:22.332499 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:22.332551 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":99,"threads_started":1}
I20260811 04:52:22.468904 4564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:22.468488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:48043)
0811 04:52:22.468751 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:22.468808 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":99,"threads_started":1}
I20260811 04:52:22.664600 4565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:22.664112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.67:43151)
0811 04:52:22.664427 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:22.664498 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":82,"threads_started":1}
I20260811 04:52:23.334122 4566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:23.333694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.65:50335)
0811 04:52:23.333971 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:23.334025 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":95,"threads_started":1}
I20260811 04:52:23.470471 4567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:23.470029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:43401 (local address 127.17.188.66:60369)
0811 04:52:23.470311 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:23.470372 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.126:43401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":97,"threads_started":1}
I20260811 04:52:23.646713 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4010
I20260811 04:52:23.656353 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4214
I20260811 04:52:23.664867 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4365
2026-08-11T04:52:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59556 ms)
[----------] 30 tests from SecurityITest (248363 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:23 dist-test-slave-njxd krb5kdc[4571](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:23 dist-test-slave-njxd krb5kdc[4571](info): set up 2 sockets
Aug 11 04:52:23 dist-test-slave-njxd krb5kdc[4571](info): commencing operation
krb5kdc: starting...
W20260811 04:52:24.765278 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.075s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:24 dist-test-slave-njxd krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:24.889300 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34553
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:34553
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:25.000674 4586 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:25.000931 4586 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:25.000969 4586 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:25.004881 4586 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:25.004935 4586 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:25.004953 4586 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:25.004969 4586 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:25.004984 4586 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:25.010095 4586 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:34553
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:34553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4586
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:25.011056 4586 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:25.012066 4586 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:25.020900 4591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.020912 4594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.020973 4586 server_base.cc:1034] running on GCE node
W20260811 04:52:25.020916 4592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.021755 4586 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:25.022825 4586 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:25.024031 4586 hybrid_clock.cc:648] HybridClock initialized: now 1786423945024013 us; error 29 us; skew 500 ppm
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:25.026741 4586 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:25.027621 4586 webserver.cc:460] Webserver started at http://127.17.188.126:35737/ using document root <none> and password file <none>
I20260811 04:52:25.028169 4586 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:25.028262 4586 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:25.028487 4586 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:25.030550 4586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "095ffb4159754144b806919403d8eae0"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2d68ebb626fd9f414b399000cc4c491a"
server_key_iv: "3e9cc9b9eaceff7ccc9fef904c24f503"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.031088 4586 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "095ffb4159754144b806919403d8eae0"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2d68ebb626fd9f414b399000cc4c491a"
server_key_iv: "3e9cc9b9eaceff7ccc9fef904c24f503"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.034498 4586 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:52:25.036791 4602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.038048 4586 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:25.038198 4586 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "095ffb4159754144b806919403d8eae0"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2d68ebb626fd9f414b399000cc4c491a"
server_key_iv: "3e9cc9b9eaceff7ccc9fef904c24f503"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.038309 4586 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:25.052973 4586 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:25.055903 4586 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:25.056130 4586 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:25.063689 4586 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:34553
I20260811 04:52:25.063699 4659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:34553 every 8 connection(s)
I20260811 04:52:25.064721 4586 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:25.065541 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4586
I20260811 04:52:25.065723 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:25.066027 18161 external_mini_cluster.cc:1428] Setting key 0742c19c0cd7b56b6113ba2ae6666330
I20260811 04:52:25.068221 4661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:25.076432 4661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: Bootstrap starting.
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:25.079471 4661 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:25.080256 4661 log.cc:824] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:25.082536 4661 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: No bootstrap required, opened a new log
I20260811 04:52:25.082978 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.067537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.17.188.126:34553)
0811 04:52:25.068011 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.068026 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.068061 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:25.068767 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.068786 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.069118 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.069514 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:25.070505 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.072368 (+ 1863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.073542 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.074149 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.074326 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.077884 (+ 3558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:25.077892 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:25.077912 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:25.077945 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:25.079914 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.080424 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.080431 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.080438 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.080556 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.080893 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.080896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.080897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.081351 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:25.081500 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.081876 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.082186 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":155,"threads_started":1}
I20260811 04:52:25.086565 4661 raft_consensus.cc:348] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } }
I20260811 04:52:25.086777 4661 raft_consensus.cc:374] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:25.086864 4661 raft_consensus.cc:729] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 095ffb4159754144b806919403d8eae0, State: Initialized, Role: FOLLOWER
I20260811 04:52:25.087261 4661 consensus_queue.cc:260] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } }
I20260811 04:52:25.087407 4661 raft_consensus.cc:388] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:25.087469 4661 raft_consensus.cc:482] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:25.087596 4661 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:25.088479 4661 raft_consensus.cc:504] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } }
I20260811 04:52:25.088850 4661 leader_election.cc:302] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 095ffb4159754144b806919403d8eae0; no voters:
I20260811 04:52:25.089160 4661 leader_election.cc:288] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:25.089284 4667 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:25.089545 4667 raft_consensus.cc:686] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [term 1 LEADER]: Becoming Leader. State: Replica: 095ffb4159754144b806919403d8eae0, State: Running, Role: LEADER
I20260811 04:52:25.090310 4667 consensus_queue.cc:237] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } }
I20260811 04:52:25.090487 4661 sys_catalog.cc:564] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:25.091868 4668 sys_catalog.cc:455] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "095ffb4159754144b806919403d8eae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } } }
I20260811 04:52:25.091993 4668 sys_catalog.cc:458] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:25.092402 4678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:25.092334 4669 sys_catalog.cc:455] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 095ffb4159754144b806919403d8eae0. Latest consensus state: current_term: 1 leader_uuid: "095ffb4159754144b806919403d8eae0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "095ffb4159754144b806919403d8eae0" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 34553 } } }
I20260811 04:52:25.092468 4669 sys_catalog.cc:458] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:25.095268 4678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:25.100546 4678 catalog_manager.cc:1347] Generated new cluster ID: c1439b5c15964ab29de653f94faa7eb0
I20260811 04:52:25.100658 4678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:25.111720 4678 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:25.112884 4678 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:25.122577 4678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: Generated new TSK 0
I20260811 04:52:25.123274 4678 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:52:25.162989 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:25.278142 4690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:25.278452 4690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:25.278532 4690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:25.282927 4690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:25.283028 4690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:25.283169 4690 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:25.289265 4690 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4690
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:25.290521 4690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:25.291771 4690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:25.302054 4698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.302030 4695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.302014 4696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.302307 4690 server_base.cc:1034] running on GCE node
I20260811 04:52:25.302829 4690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:25.303503 4690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:25.304756 4690 hybrid_clock.cc:648] HybridClock initialized: now 1786423945304736 us; error 40 us; skew 500 ppm
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:25.307739 4690 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:52:25.308732 4690 webserver.cc:460] Webserver started at http://127.17.188.65:44237/ using document root <none> and password file <none>
I20260811 04:52:25.309309 4690 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:25.309404 4690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:25.309765 4690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:25.312122 4690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "6ee9969640b4475db18de40d274d3d43"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2703f1f78ce9f6c1ae4baea1404baf26"
server_key_iv: "4540a98b077911722d8279c6b47174f4"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.312647 4690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "6ee9969640b4475db18de40d274d3d43"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2703f1f78ce9f6c1ae4baea1404baf26"
server_key_iv: "4540a98b077911722d8279c6b47174f4"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.316354 4690 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260811 04:52:25.318709 4707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.319962 4690 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:25.320142 4690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "6ee9969640b4475db18de40d274d3d43"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "2703f1f78ce9f6c1ae4baea1404baf26"
server_key_iv: "4540a98b077911722d8279c6b47174f4"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.320243 4690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:25.336921 4690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:25.340348 4690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:25.340507 4690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:25.341096 4690 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:25.342051 4690 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:25.342099 4690 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.342171 4690 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:25.342202 4690 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.350881 4690 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:35129
I20260811 04:52:25.350917 4838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:35129 every 8 connection(s)
I20260811 04:52:25.351804 4690 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:25.360844 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4690
I20260811 04:52:25.361011 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:25.361424 18161 external_mini_cluster.cc:1428] Setting key 0d29dbdda6c3dceb8461848b6a61850c
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:25.366498 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.353692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:43271 (local address 127.17.188.126:34553)
0811 04:52:25.353834 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.353838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.354711 (+ 873us) server_negotiation.cc:407] Connection header received
0811 04:52:25.356101 (+ 1390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.356105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.356165 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.356274 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:25.357476 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.358096 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.359261 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.359506 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.359630 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.362534 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:25.362537 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:25.362540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:25.362571 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:25.364033 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.364682 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.364685 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.364687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.364760 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.365170 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.365176 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.365179 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.365442 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:25.365553 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.366131 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.366289 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:52:25.367257 4841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.354074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34553 (local address 127.17.188.65:43271)
0811 04:52:25.354522 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.354601 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.355870 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.356457 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.356464 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.356837 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:25.357319 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.357333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.358238 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.358247 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.359129 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.359139 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.359677 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.359681 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.359854 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.360492 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:25.360509 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:25.362349 (+ 1840us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:25.364157 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.364166 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.364186 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.364573 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.364853 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.364859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.364863 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.365059 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.365556 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:25.365562 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:25.365873 (+ 311us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.366044 (+ 171us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.366315 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":104,"threads_started":1}
I20260811 04:52:25.368677 4839 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34553
I20260811 04:52:25.368937 4839 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:25.369398 4839 heartbeater.cc:511] Master 127.17.188.126:34553 requested a full tablet report, sending...
I20260811 04:52:25.370956 4622 ts_manager.cc:194] Registered new tserver with Master: 6ee9969640b4475db18de40d274d3d43 (127.17.188.65:35129)
I20260811 04:52:25.372066 4622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:43271
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:52:25.392552 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:25.511379 4845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:25.511674 4845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:25.511719 4845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:25.515806 4845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:25.515884 4845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:25.515945 4845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:25.521322 4845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:25.522574 4845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:25.523715 4845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:52:25.533612 4845 server_base.cc:1034] running on GCE node
W20260811 04:52:25.533803 4853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.533901 4855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.533849 4852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.534377 4845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:25.534969 4845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:25.536137 4845 hybrid_clock.cc:648] HybridClock initialized: now 1786423945536115 us; error 39 us; skew 500 ppm
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:25.539026 4845 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:52:25.539921 4845 webserver.cc:460] Webserver started at http://127.17.188.66:36561/ using document root <none> and password file <none>
I20260811 04:52:25.540470 4845 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:25.540529 4845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:25.540784 4845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:25.542979 4845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "bb4692f2eee24e18a85b50599df5bac5"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "8f8b4958176f1abc4965650b7cb0356a"
server_key_iv: "96435897235a355147527be8d558a996"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.543565 4845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "bb4692f2eee24e18a85b50599df5bac5"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "8f8b4958176f1abc4965650b7cb0356a"
server_key_iv: "96435897235a355147527be8d558a996"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.547260 4845 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:25.549736 4866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.550928 4845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:25.551066 4845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "bb4692f2eee24e18a85b50599df5bac5"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "8f8b4958176f1abc4965650b7cb0356a"
server_key_iv: "96435897235a355147527be8d558a996"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.551182 4845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:25.564898 4845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:25.567716 4845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:25.567926 4845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:25.568502 4845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:25.569345 4845 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:25.569412 4845 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.569504 4845 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:25.569536 4845 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.578369 4845 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:44009
I20260811 04:52:25.578393 4994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:44009 every 8 connection(s)
I20260811 04:52:25.579276 4845 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:25.579775 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 4845
I20260811 04:52:25.579919 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:25.580264 18161 external_mini_cluster.cc:1428] Setting key a5a163723d453096634f4f21569a1f40
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:52:25.595747 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.581340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:36369 (local address 127.17.188.126:34553)
0811 04:52:25.581484 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.581488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.582671 (+ 1183us) server_negotiation.cc:407] Connection header received
0811 04:52:25.584063 (+ 1392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.584066 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.584125 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.584233 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:25.585731 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.586527 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.587724 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.587968 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.588087 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.591238 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:25.591241 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:25.591243 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:25.591270 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:25.593012 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.593620 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.593624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.593625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.593724 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.594112 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.594114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.594116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.594313 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:25.594433 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.595326 (+ 893us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.595475 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:52:25.596508 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.581895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34553 (local address 127.17.188.66:36369)
0811 04:52:25.582515 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.582560 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.583832 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.584422 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.584430 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.584792 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:25.585482 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.585504 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.586666 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.586669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.587584 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.587594 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.588135 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.588139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.588338 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.588997 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:25.589015 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:25.591027 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:25.593137 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.593143 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.593177 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.593471 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.593853 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.593856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.593858 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.594010 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.594432 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:25.594438 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:25.594942 (+ 504us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.595220 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.595515 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":168,"threads_started":1}
I20260811 04:52:25.598021 4995 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34553
I20260811 04:52:25.598296 4995 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:25.598909 4995 heartbeater.cc:511] Master 127.17.188.126:34553 requested a full tablet report, sending...
I20260811 04:52:25.600121 4622 ts_manager.cc:194] Registered new tserver with Master: bb4692f2eee24e18a85b50599df5bac5 (127.17.188.66:44009)
I20260811 04:52:25.600713 4622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:36369
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:52:25.613623 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:33095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:25.744019 5000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:25.744283 5000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:25.744351 5000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:25.748234 5000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:25.748317 5000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:25.748410 5000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:25.753684 5000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:33095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:34553
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:25.754804 5000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:25.755877 5000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:25.765872 5008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.765950 5000 server_base.cc:1034] running on GCE node
W20260811 04:52:25.765872 5012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:25.765938 5009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:25.766571 5000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:25.767189 5000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:25.768357 5000 hybrid_clock.cc:648] HybridClock initialized: now 1786423945768343 us; error 26 us; skew 500 ppm
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:25.771106 5000 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:52:25.771991 5000 webserver.cc:460] Webserver started at http://127.17.188.67:44633/ using document root <none> and password file <none>
I20260811 04:52:25.772568 5000 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:25.772668 5000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:25.772919 5000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:25.775033 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "27b978460b7346ab8e7cb30d97e800b3"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "52cddb579b4cbdd5139a2c287d018762"
server_key_iv: "545edbe4ee25134c82e8fd6b3ab290e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.775938 5000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "27b978460b7346ab8e7cb30d97e800b3"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "52cddb579b4cbdd5139a2c287d018762"
server_key_iv: "545edbe4ee25134c82e8fd6b3ab290e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.779668 5000 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 04:52:25.782116 5021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.783336 5000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:25.783474 5000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "27b978460b7346ab8e7cb30d97e800b3"
format_stamp: "Formatted at 2026-08-11 04:52:25 on dist-test-slave-njxd"
server_key: "52cddb579b4cbdd5139a2c287d018762"
server_key_iv: "545edbe4ee25134c82e8fd6b3ab290e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:25.783593 5000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:25.818553 5000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:25.821378 5000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:25.821720 5000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:25.822343 5000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:25.823194 5000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:25.823266 5000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.823336 5000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:25.823390 5000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:25.832197 5000 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:35121
I20260811 04:52:25.832226 5144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:35121 every 8 connection(s)
I20260811 04:52:25.833065 5000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:25.841890 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5000
I20260811 04:52:25.842074 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:25.842379 18161 external_mini_cluster.cc:1428] Setting key 78e7f17db16697ff39b00602572bad48
Aug 11 04:52:25 dist-test-slave-njxd krb5kdc[4571](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423945, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:25.847426 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.834916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:54205 (local address 127.17.188.126:34553)
0811 04:52:25.835057 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.835061 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.835830 (+ 769us) server_negotiation.cc:407] Connection header received
0811 04:52:25.837123 (+ 1293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.837126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.837176 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.837252 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:25.838458 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.839118 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.840226 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.840430 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.840506 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.843325 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:25.843329 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:25.843331 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:25.843353 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:25.845325 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.845906 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.845910 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.845912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.845993 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.846331 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.846334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.846336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.846511 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:25.846620 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.847130 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.847260 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:52:25.848176 5148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.835215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:34553 (local address 127.17.188.67:54205)
0811 04:52:25.835663 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.835705 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.836923 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.837419 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.837426 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.837846 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:25.838328 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.838341 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.839234 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.839237 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.840121 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.840131 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.840563 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.840565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.840704 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.841334 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:25.841349 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:25.843158 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:25.845450 (+ 2292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.845455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.845470 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.845806 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.846089 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:25.846092 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:25.846093 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:25.846231 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:25.846618 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:25.846624 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:25.846889 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.847071 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.847382 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":115,"threads_started":1}
I20260811 04:52:25.849280 5145 heartbeater.cc:347] Connected to a master server at 127.17.188.126:34553
I20260811 04:52:25.849504 5145 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:25.849977 5145 heartbeater.cc:511] Master 127.17.188.126:34553 requested a full tablet report, sending...
I20260811 04:52:25.850927 4622 ts_manager.cc:194] Registered new tserver with Master: 27b978460b7346ab8e7cb30d97e800b3 (127.17.188.67:35121)
I20260811 04:52:25.851475 4622 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:54205
I20260811 04:52:25.856268 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:25.864980 4665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.858273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.17.188.126:34553)
0811 04:52:25.858390 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.858393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.858618 (+ 225us) server_negotiation.cc:407] Connection header received
0811 04:52:25.858704 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.858707 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.858742 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.858805 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:25.859464 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.859954 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.860728 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.860917 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.860984 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.862365 (+ 1381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:25.862368 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:25.862369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:25.862387 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:25.863587 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.863976 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.863979 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.863980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.864047 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:25.864280 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:25.864282 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:25.864283 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:25.864482 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:25.864579 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.864770 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.864873 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 04:52:25.868075 4622 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:25.871304 4622 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:25.885694 5159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.879741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44009 (local address 127.0.0.1:33920)
0811 04:52:25.880223 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.880271 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.880400 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.881477 (+ 1077us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.881482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.881506 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:25.881676 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.881684 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.883337 (+ 1653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.883340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.884305 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.884315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.885144 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.885147 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.885253 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.885290 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.885401 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.885519 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":21,"thread_start_us":99,"threads_started":1}
I20260811 04:52:25.885697 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.879916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33920 (local address 127.17.188.66:44009)
0811 04:52:25.880896 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.880911 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.880943 (+ 32us) server_negotiation.cc:407] Connection header received
0811 04:52:25.881028 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.881033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.881256 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.881469 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:25.881824 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.883199 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.884431 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.885012 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.885151 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.885300 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.885428 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.885519 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":874,"thread_start_us":149,"threads_started":1}
I20260811 04:52:25.885926 5163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.880486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:35121 (local address 127.0.0.1:49718)
0811 04:52:25.881196 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.881208 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.881283 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.881965 (+ 682us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.881971 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.881993 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:25.882083 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.882088 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.883041 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.883046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.884246 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.884257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.885515 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.885520 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.885636 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.885661 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.885731 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.885798 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":113,"threads_started":1}
I20260811 04:52:25.886346 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.880821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49718 (local address 127.17.188.67:35121)
0811 04:52:25.881231 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.881242 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.881263 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:52:25.881472 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.881477 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.881707 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.881858 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:25.882198 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.882907 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.884390 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.885224 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.885324 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.885451 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.886122 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.886228 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":121,"threads_started":1}
I20260811 04:52:25.887620 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.879911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35129 (local address 127.0.0.1:54596)
0811 04:52:25.881037 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.881051 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.881212 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.881792 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.881795 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.881814 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:25.881926 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.881935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.883275 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.883279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.885417 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.885427 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.887238 (+ 1811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.887242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.887328 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.887349 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.887425 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.887493 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":102,"threads_started":1}
I20260811 04:52:25.887724 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.880455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54596 (local address 127.17.188.65:35129)
0811 04:52:25.880888 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.880897 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.881138 (+ 241us) server_negotiation.cc:407] Connection header received
0811 04:52:25.881418 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.881424 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.881647 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.881815 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:25.882039 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.883128 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.885554 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.886904 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.886986 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.887135 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.887480 (+ 345us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.887584 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":116,"threads_started":1}
I20260811 04:52:25.889097 4921 tablet_service.cc:1467] Processing CreateTablet for tablet fbd355b5c09f49989124bb486cf80ddb (DEFAULT_TABLE table=test-table [id=208d4849268143a4b7d8fbc4e592f286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:25.889107 5074 tablet_service.cc:1467] Processing CreateTablet for tablet fbd355b5c09f49989124bb486cf80ddb (DEFAULT_TABLE table=test-table [id=208d4849268143a4b7d8fbc4e592f286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:25.890184 4921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd355b5c09f49989124bb486cf80ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:25.890189 5074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd355b5c09f49989124bb486cf80ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:25.890404 4765 tablet_service.cc:1467] Processing CreateTablet for tablet fbd355b5c09f49989124bb486cf80ddb (DEFAULT_TABLE table=test-table [id=208d4849268143a4b7d8fbc4e592f286]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:25.891306 4765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbd355b5c09f49989124bb486cf80ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:25.896678 5165 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Bootstrap starting.
I20260811 04:52:25.898114 5167 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: Bootstrap starting.
I20260811 04:52:25.899050 5165 tablet_bootstrap.cc:654] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:25.899917 5167 tablet_bootstrap.cc:654] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:25.900254 5165 log.cc:824] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:25.900715 5167 log.cc:824] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:25.901008 5166 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Bootstrap starting.
I20260811 04:52:25.902554 5167 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: No bootstrap required, opened a new log
I20260811 04:52:25.902755 5165 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: No bootstrap required, opened a new log
I20260811 04:52:25.902912 5167 ts_tablet_manager.cc:1397] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 04:52:25.902952 5165 ts_tablet_manager.cc:1397] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:25.903141 5166 tablet_bootstrap.cc:654] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:25.904386 5166 log.cc:824] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:25.906411 5166 tablet_bootstrap.cc:492] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: No bootstrap required, opened a new log
I20260811 04:52:25.906594 5166 ts_tablet_manager.cc:1397] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:25.906674 5167 raft_consensus.cc:348] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.906961 5167 raft_consensus.cc:374] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:25.906795 5165 raft_consensus.cc:348] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.907039 5167 raft_consensus.cc:729] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ee9969640b4475db18de40d274d3d43, State: Initialized, Role: FOLLOWER
I20260811 04:52:25.907054 5165 raft_consensus.cc:374] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:25.907135 5165 raft_consensus.cc:729] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb4692f2eee24e18a85b50599df5bac5, State: Initialized, Role: FOLLOWER
I20260811 04:52:25.907541 5167 consensus_queue.cc:260] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.908197 4839 heartbeater.cc:503] Master 127.17.188.126:34553 was elected leader, sending a full tablet report...
I20260811 04:52:25.907622 5165 consensus_queue.cc:260] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.908524 5167 ts_tablet_manager.cc:1428] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260811 04:52:25.909094 4995 heartbeater.cc:503] Master 127.17.188.126:34553 was elected leader, sending a full tablet report...
I20260811 04:52:25.909229 5165 ts_tablet_manager.cc:1428] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 04:52:25.910223 5166 raft_consensus.cc:348] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.910398 5166 raft_consensus.cc:374] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:25.910430 5166 raft_consensus.cc:729] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27b978460b7346ab8e7cb30d97e800b3, State: Initialized, Role: FOLLOWER
I20260811 04:52:25.910799 5166 consensus_queue.cc:260] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.911392 5145 heartbeater.cc:503] Master 127.17.188.126:34553 was elected leader, sending a full tablet report...
I20260811 04:52:25.911695 5166 ts_tablet_manager.cc:1428] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:52:25.940876 5172 raft_consensus.cc:482] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:25.941066 5172 raft_consensus.cc:504] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.942337 5172 leader_election.cc:288] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ee9969640b4475db18de40d274d3d43 (127.17.188.65:35129), 27b978460b7346ab8e7cb30d97e800b3 (127.17.188.67:35121)
I20260811 04:52:25.947464 5164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.942854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:37703 (local address 127.17.188.67:35121)
0811 04:52:25.943341 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.943347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.943362 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:52:25.943410 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.943412 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.943461 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.943535 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:25.943780 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.944508 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946141 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.946759 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946884 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.946935 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.947272 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.947338 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383}
I20260811 04:52:25.947480 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.942757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:55537 (local address 127.17.188.65:35129)
0811 04:52:25.942926 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.942933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.943326 (+ 393us) server_negotiation.cc:407] Connection header received
0811 04:52:25.943411 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.943413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.943457 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.943533 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:25.943942 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.944664 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946141 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.946759 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946884 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.946935 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.947272 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.947343 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:52:25.947472 4997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.942582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:35121 (local address 127.17.188.66:37703)
0811 04:52:25.943030 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.943062 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.943155 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.943555 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.943557 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.943569 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:25.943678 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.943683 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.944623 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.944625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.946005 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.946017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.946889 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.947054 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.947131 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.947227 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.947320 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":326,"mutex_wait_us":128}
I20260811 04:52:25.947481 5175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.942582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35129 (local address 127.17.188.66:55537)
0811 04:52:25.943230 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:25.943241 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:25.943329 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:25.943766 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:25.943767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:25.943777 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:25.943848 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.943851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.944766 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.944769 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.946005 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:25.946017 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.946889 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.946892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:25.947131 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.947149 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 04:52:25.947236 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 04:52:25.947320 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":384,"thread_start_us":185,"threads_started":1}
I20260811 04:52:25.948283 5095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd355b5c09f49989124bb486cf80ddb" candidate_uuid: "bb4692f2eee24e18a85b50599df5bac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b978460b7346ab8e7cb30d97e800b3" is_pre_election: true
I20260811 04:52:25.948550 4790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd355b5c09f49989124bb486cf80ddb" candidate_uuid: "bb4692f2eee24e18a85b50599df5bac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee9969640b4475db18de40d274d3d43" is_pre_election: true
I20260811 04:52:25.948588 5095 raft_consensus.cc:2454] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4692f2eee24e18a85b50599df5bac5 in term 0.
I20260811 04:52:25.948828 4790 raft_consensus.cc:2454] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb4692f2eee24e18a85b50599df5bac5 in term 0.
I20260811 04:52:25.949076 4868 leader_election.cc:302] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27b978460b7346ab8e7cb30d97e800b3, bb4692f2eee24e18a85b50599df5bac5; no voters:
I20260811 04:52:25.949342 5172 raft_consensus.cc:2781] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:25.949450 5172 raft_consensus.cc:482] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:25.949507 5172 raft_consensus.cc:3037] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:25.950567 5172 raft_consensus.cc:504] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.950901 5172 leader_election.cc:288] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [CANDIDATE]: Term 1 election: Requested vote from peers 6ee9969640b4475db18de40d274d3d43 (127.17.188.65:35129), 27b978460b7346ab8e7cb30d97e800b3 (127.17.188.67:35121)
I20260811 04:52:25.951277 4790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd355b5c09f49989124bb486cf80ddb" candidate_uuid: "bb4692f2eee24e18a85b50599df5bac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ee9969640b4475db18de40d274d3d43"
I20260811 04:52:25.951294 5095 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbd355b5c09f49989124bb486cf80ddb" candidate_uuid: "bb4692f2eee24e18a85b50599df5bac5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27b978460b7346ab8e7cb30d97e800b3"
I20260811 04:52:25.951383 4790 raft_consensus.cc:3037] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:25.951421 5095 raft_consensus.cc:3037] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:25.952454 5095 raft_consensus.cc:2454] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4692f2eee24e18a85b50599df5bac5 in term 1.
I20260811 04:52:25.952486 4790 raft_consensus.cc:2454] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bb4692f2eee24e18a85b50599df5bac5 in term 1.
I20260811 04:52:25.952791 4868 leader_election.cc:302] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27b978460b7346ab8e7cb30d97e800b3, bb4692f2eee24e18a85b50599df5bac5; no voters:
I20260811 04:52:25.952976 5172 raft_consensus.cc:2781] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:25.953251 5172 raft_consensus.cc:686] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 1 LEADER]: Becoming Leader. State: Replica: bb4692f2eee24e18a85b50599df5bac5, State: Running, Role: LEADER
I20260811 04:52:25.953622 5172 consensus_queue.cc:237] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } }
I20260811 04:52:25.957095 4622 catalog_manager.cc:5495] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 reported cstate change: term changed from 0 to 1, leader changed from <none> to bb4692f2eee24e18a85b50599df5bac5 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "bb4692f2eee24e18a85b50599df5bac5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb4692f2eee24e18a85b50599df5bac5" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 } health_report { overall_health: UNKNOWN } } }
I20260811 04:52:25.983273 5161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:25.979421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33922 (local address 127.17.188.66:44009)
0811 04:52:25.979574 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:25.979579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:25.979594 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:52:25.979778 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:25.979781 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:25.979842 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:25.979957 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:25.980218 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.980730 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.981732 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:25.981960 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:25.982079 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:25.982411 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:25.982838 (+ 427us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:25.982985 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:25.983045 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 04:52:25.983103 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:52:25.989217 5095 raft_consensus.cc:1261] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 1 FOLLOWER]: Refusing update from remote peer bb4692f2eee24e18a85b50599df5bac5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:25.989238 4790 raft_consensus.cc:1261] T fbd355b5c09f49989124bb486cf80ddb P 6ee9969640b4475db18de40d274d3d43 [term 1 FOLLOWER]: Refusing update from remote peer bb4692f2eee24e18a85b50599df5bac5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:25.989971 5176 consensus_queue.cc:1035] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27b978460b7346ab8e7cb30d97e800b3" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 35121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:25.990167 5172 consensus_queue.cc:1035] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ee9969640b4475db18de40d274d3d43" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:25.998682 5181 mvcc.cc:205] Tried to move back new op lower bound from 7317192482763825152 to 7317192482628616192. Current Snapshot: MvccSnapshot[applied={T|T < 7317192482763825152}]
I20260811 04:52:26.000387 5180 mvcc.cc:205] Tried to move back new op lower bound from 7317192482763825152 to 7317192482628616192. Current Snapshot: MvccSnapshot[applied={T|T < 7317192482763825152}]
I20260811 04:52:26.007450 4622 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:26.007660 4622 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:26.010175 4622 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 095ffb4159754144b806919403d8eae0: Sending DeleteTablet for 3 replicas of tablet fbd355b5c09f49989124bb486cf80ddb
I20260811 04:52:26.011068 4765 tablet_service.cc:1514] Processing DeleteTablet for tablet fbd355b5c09f49989124bb486cf80ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:54596
I20260811 04:52:26.011133 4921 tablet_service.cc:1514] Processing DeleteTablet for tablet fbd355b5c09f49989124bb486cf80ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:33920
I20260811 04:52:26.011591 5190 tablet_replica.cc:330] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: stopping tablet replica
I20260811 04:52:26.011581 5074 tablet_service.cc:1514] Processing DeleteTablet for tablet fbd355b5c09f49989124bb486cf80ddb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:26 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:49718
I20260811 04:52:26.011932 5190 raft_consensus.cc:2229] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:52:26.012135 5193 tablet_replica.cc:330] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: stopping tablet replica
I20260811 04:52:26.012279 5190 raft_consensus.cc:2258] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:26.012537 5193 raft_consensus.cc:2229] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:26.012809 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4690
I20260811 04:52:26.012982 5193 raft_consensus.cc:2258] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:26.015071 5190 ts_tablet_manager.cc:1905] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:26.017994 5190 ts_tablet_manager.cc:1918] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:26.018095 5190 log.cc:1196] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/fbd355b5c09f49989124bb486cf80ddb
I20260811 04:52:26.018432 5190 ts_tablet_manager.cc:1939] T fbd355b5c09f49989124bb486cf80ddb P bb4692f2eee24e18a85b50599df5bac5: Deleting consensus metadata
I20260811 04:52:26.019251 5193 ts_tablet_manager.cc:1905] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:26.019585 4605 catalog_manager.cc:4841] TS bb4692f2eee24e18a85b50599df5bac5 (127.17.188.66:44009): tablet fbd355b5c09f49989124bb486cf80ddb (table test-table [id=208d4849268143a4b7d8fbc4e592f286]) successfully deleted
I20260811 04:52:26.022584 5193 ts_tablet_manager.cc:1918] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:26.022702 5193 log.cc:1196] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/fbd355b5c09f49989124bb486cf80ddb
I20260811 04:52:26.023046 5193 ts_tablet_manager.cc:1939] T fbd355b5c09f49989124bb486cf80ddb P 27b978460b7346ab8e7cb30d97e800b3: Deleting consensus metadata
I20260811 04:52:26.024304 4605 catalog_manager.cc:4841] TS 27b978460b7346ab8e7cb30d97e800b3 (127.17.188.67:35121): tablet fbd355b5c09f49989124bb486cf80ddb (table test-table [id=208d4849268143a4b7d8fbc4e592f286]) successfully deleted
W20260811 04:52:26.026684 4607 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:35129 (error 108)
I20260811 04:52:26.027626 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4845
I20260811 04:52:26.027839 5160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.027485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35129 (local address 127.0.0.1:54598)
0811 04:52:26.027644 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.027732 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:35129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 04:52:26.029356 4607 catalog_manager.cc:4584] TS 6ee9969640b4475db18de40d274d3d43 (127.17.188.65:35129): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fbd355b5c09f49989124bb486cf80ddb: Network error: Client connection negotiation failed: client connection to 127.17.188.65:35129: connect: Connection refused (error 111)
I20260811 04:52:26.035786 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5000
I20260811 04:52:26.044093 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 4586
2026-08-11T04:52:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2377 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T04:52:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:26Z Disabled control of system clock
I20260811 04:52:26.077037 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42109
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:42109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:26.187425 5199 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:26.187697 5199 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:26.187733 5199 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:26.191751 5199 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:26.191811 5199 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:26.191828 5199 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:26.191843 5199 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:26.191900 5199 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:26.196700 5199 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:42109
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:42109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5199
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:26.197911 5199 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:26.199327 5199 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:26.207851 5205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.207860 5209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:26.208051 5199 server_base.cc:1034] running on GCE node
W20260811 04:52:26.207890 5207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:26.208832 5199 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:26.210041 5199 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:26.211213 5199 hybrid_clock.cc:648] HybridClock initialized: now 1786423946211183 us; error 41 us; skew 500 ppm
I20260811 04:52:26.213090 5199 webserver.cc:460] Webserver started at http://127.17.188.126:34093/ using document root <none> and password file <none>
I20260811 04:52:26.213786 5199 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:26.213856 5199 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:26.214111 5199 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:26.216379 5199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "ac3454895a3d4727b10fe0c7a932b7bb"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "b96b0f15333d3af95e06281e161e17a9"
server_key_iv: "b24e103f1c76bebee560a8084e05a941"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.216961 5199 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "ac3454895a3d4727b10fe0c7a932b7bb"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "b96b0f15333d3af95e06281e161e17a9"
server_key_iv: "b24e103f1c76bebee560a8084e05a941"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.220810 5199 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 04:52:26.223513 5215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.224852 5199 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:26.225000 5199 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "ac3454895a3d4727b10fe0c7a932b7bb"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "b96b0f15333d3af95e06281e161e17a9"
server_key_iv: "b24e103f1c76bebee560a8084e05a941"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.225124 5199 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:26.253131 5199 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:26.253996 5199 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:26.254221 5199 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:26.261828 5199 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:42109
I20260811 04:52:26.261873 5276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:42109 every 8 connection(s)
I20260811 04:52:26.262853 5199 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:26.263231 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5199
I20260811 04:52:26.263378 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:26.263710 18161 external_mini_cluster.cc:1428] Setting key 9341253f191710d3742c02343c343d83
I20260811 04:52:26.266476 5277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:26.273041 5277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: Bootstrap starting.
I20260811 04:52:26.273068 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.265210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57986 (local address 127.17.188.126:42109)
0811 04:52:26.265870 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.265886 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.265922 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:52:26.266606 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.266631 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.267016 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.267307 (+ 291us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:26.267655 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.268595 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.269792 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.270231 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.270345 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.271290 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:26.271295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:26.271307 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:26.271698 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:26.271754 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:26.271773 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:26.271848 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.272042 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.272356 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":162,"threads_started":1}
I20260811 04:52:26.275695 5277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:26.276449 5277 log.cc:824] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:26.278472 5277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: No bootstrap required, opened a new log
I20260811 04:52:26.282255 5277 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } }
I20260811 04:52:26.282487 5277 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:26.282568 5277 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac3454895a3d4727b10fe0c7a932b7bb, State: Initialized, Role: FOLLOWER
I20260811 04:52:26.282995 5277 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } }
I20260811 04:52:26.283139 5277 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:26.283213 5277 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:26.283360 5277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:26.284312 5277 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } }
I20260811 04:52:26.284670 5277 leader_election.cc:302] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac3454895a3d4727b10fe0c7a932b7bb; no voters:
I20260811 04:52:26.285012 5277 leader_election.cc:288] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:26.285131 5282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:26.285405 5282 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [term 1 LEADER]: Becoming Leader. State: Replica: ac3454895a3d4727b10fe0c7a932b7bb, State: Running, Role: LEADER
I20260811 04:52:26.285740 5282 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } }
I20260811 04:52:26.286463 5277 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:26.287559 5284 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac3454895a3d4727b10fe0c7a932b7bb. Latest consensus state: current_term: 1 leader_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } } }
I20260811 04:52:26.287696 5284 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:26.288100 5294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:26.288085 5283 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac3454895a3d4727b10fe0c7a932b7bb" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 42109 } } }
I20260811 04:52:26.288792 5283 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:26.290840 5294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:26.296633 5294 catalog_manager.cc:1347] Generated new cluster ID: 06bcc1a07993476696b2c79383aab21f
I20260811 04:52:26.296715 5294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:26.315274 5294 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:26.316324 5294 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:26.323905 5294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: Generated new TSK 0
I20260811 04:52:26.324576 5294 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:26.336385 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--builtin_ntp_servers=127.17.188.84:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:26.463971 5304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:26.464244 5304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:26.464285 5304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:26.468356 5304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:26.468421 5304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:26.468521 5304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:26.473307 5304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:26.474510 5304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:26.475992 5304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:26.485705 5310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.485721 5309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.485721 5312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:26.485877 5304 server_base.cc:1034] running on GCE node
I20260811 04:52:26.486393 5304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:26.487093 5304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:26.488256 5304 hybrid_clock.cc:648] HybridClock initialized: now 1786423946488223 us; error 43 us; skew 500 ppm
I20260811 04:52:26.490262 5304 webserver.cc:460] Webserver started at http://127.17.188.65:34401/ using document root <none> and password file <none>
I20260811 04:52:26.490837 5304 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:26.490901 5304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:26.491173 5304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:26.493300 5304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "330990faece746f0940b9f340cd069b2"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ecc3efa43842098e4d0fe28e1c521860"
server_key_iv: "97d490e100e321c05d362d19225dcb89"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.493911 5304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "330990faece746f0940b9f340cd069b2"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ecc3efa43842098e4d0fe28e1c521860"
server_key_iv: "97d490e100e321c05d362d19225dcb89"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.497637 5304 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:52:26.500007 5318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.501362 5304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:26.501497 5304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "330990faece746f0940b9f340cd069b2"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ecc3efa43842098e4d0fe28e1c521860"
server_key_iv: "97d490e100e321c05d362d19225dcb89"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.501652 5304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:26.525421 5304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:26.526259 5304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:26.526485 5304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:26.527158 5304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:26.528314 5304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:26.528421 5304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.528498 5304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:26.528530 5304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.538071 5304 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:35575
I20260811 04:52:26.538177 5451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:35575 every 8 connection(s)
I20260811 04:52:26.539187 5304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:26.545104 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5304
I20260811 04:52:26.545282 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:26.545639 18161 external_mini_cluster.cc:1428] Setting key c6e9c58e126823a46725c8a43678324a
I20260811 04:52:26.547923 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--builtin_ntp_servers=127.17.188.84:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:26.549765 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.541286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:39449 (local address 127.17.188.126:42109)
0811 04:52:26.541438 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.541442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.542576 (+ 1134us) server_negotiation.cc:407] Connection header received
0811 04:52:26.544018 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.544020 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.544074 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.544151 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:26.545157 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.545899 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.547381 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.547669 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.547770 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.549187 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:26.549190 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:26.549192 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:26.549205 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:26.549226 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:26.549234 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:26.549295 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.549503 (+ 208us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.549632 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:52:26.550917 5454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.541745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42109 (local address 127.17.188.65:39449)
0811 04:52:26.542439 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.542483 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.543810 (+ 1327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.544297 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.544304 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.544388 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:26.544995 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.545017 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.546035 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.546039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.547229 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.547243 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.547850 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.547855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.548071 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.548843 (+ 772us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:26.548847 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:26.548910 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:26.549010 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:26.549327 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:26.549341 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:26.549350 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.549494 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.549889 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":117,"threads_started":1}
I20260811 04:52:26.552380 5452 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42109
I20260811 04:52:26.552657 5452 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:26.553251 5452 heartbeater.cc:511] Master 127.17.188.126:42109 requested a full tablet report, sending...
I20260811 04:52:26.554993 5234 ts_manager.cc:194] Registered new tserver with Master: 330990faece746f0940b9f340cd069b2 (127.17.188.65:35575)
I20260811 04:52:26.556173 5234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.65:39449
W20260811 04:52:26.664808 5455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:26.665105 5455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:26.665144 5455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:26.669375 5455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:26.669446 5455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:26.669549 5455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:26.674921 5455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:26.676122 5455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:26.677636 5455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:26.687577 5460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.687590 5461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.687590 5463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:26.688063 5455 server_base.cc:1034] running on GCE node
I20260811 04:52:26.688617 5455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:26.689235 5455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:26.690405 5455 hybrid_clock.cc:648] HybridClock initialized: now 1786423946690384 us; error 31 us; skew 500 ppm
I20260811 04:52:26.692250 5455 webserver.cc:460] Webserver started at http://127.17.188.66:46079/ using document root <none> and password file <none>
I20260811 04:52:26.692854 5455 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:26.692916 5455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:26.693190 5455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:26.695380 5455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "e2ecbae89a064ae39bd6403344430d55"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "226c3411a0b19ff581da54171e01f3b9"
server_key_iv: "b6ffd2a13d1dc9ace6e00bdab9e46a7b"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.695974 5455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "e2ecbae89a064ae39bd6403344430d55"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "226c3411a0b19ff581da54171e01f3b9"
server_key_iv: "b6ffd2a13d1dc9ace6e00bdab9e46a7b"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.699695 5455 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260811 04:52:26.702255 5469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.703426 5455 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:52:26.703567 5455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "e2ecbae89a064ae39bd6403344430d55"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "226c3411a0b19ff581da54171e01f3b9"
server_key_iv: "b6ffd2a13d1dc9ace6e00bdab9e46a7b"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.703699 5455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:26.718860 5455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:26.719533 5455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:26.719746 5455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:26.720330 5455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:26.721257 5455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:26.721331 5455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.721401 5455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:26.721446 5455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.730592 5455 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:42155
I20260811 04:52:26.730636 5606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:42155 every 8 connection(s)
I20260811 04:52:26.731479 5455 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:26.736487 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5455
I20260811 04:52:26.736621 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:26.737003 18161 external_mini_cluster.cc:1428] Setting key 08461e3b8a9bb5dfabf07e3d342bd993
I20260811 04:52:26.739217 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--builtin_ntp_servers=127.17.188.84:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:26.741613 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.733208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:33987 (local address 127.17.188.126:42109)
0811 04:52:26.733358 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.733362 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.734476 (+ 1114us) server_negotiation.cc:407] Connection header received
0811 04:52:26.735839 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.735841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.735891 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.735969 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:26.737001 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.737723 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.739336 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.739597 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.739678 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.740984 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:26.740987 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:26.740989 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:26.741000 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:26.741018 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:26.741026 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:26.741124 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.741339 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.741407 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 04:52:26.742408 5611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.733696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42109 (local address 127.17.188.66:33987)
0811 04:52:26.734325 (+ 629us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.734366 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.735647 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.736136 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.736143 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.736235 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:26.736813 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.736842 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.737882 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.737885 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.739179 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.739193 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.739758 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.739765 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.740013 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.740674 (+ 661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:26.740678 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:26.740734 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:26.740829 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:26.741148 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:26.741162 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:26.741169 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.741317 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.741528 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":103,"threads_started":1}
I20260811 04:52:26.743566 5608 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42109
I20260811 04:52:26.743818 5608 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:26.744385 5608 heartbeater.cc:511] Master 127.17.188.126:42109 requested a full tablet report, sending...
I20260811 04:52:26.745393 5234 ts_manager.cc:194] Registered new tserver with Master: e2ecbae89a064ae39bd6403344430d55 (127.17.188.66:42155)
I20260811 04:52:26.746035 5234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.66:33987
W20260811 04:52:26.852869 5612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:26.853149 5612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:26.853231 5612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:26.857229 5612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:26.857312 5612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:26.857404 5612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:26.862036 5612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:42109
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:26.863059 5612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:26.864423 5612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:52:26.874022 5612 server_base.cc:1034] running on GCE node
W20260811 04:52:26.874011 5620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.873972 5617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:26.874001 5618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:26.874816 5612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:26.875357 5612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:26.876514 5612 hybrid_clock.cc:648] HybridClock initialized: now 1786423946876504 us; error 36 us; skew 500 ppm
I20260811 04:52:26.878363 5612 webserver.cc:460] Webserver started at http://127.17.188.67:44623/ using document root <none> and password file <none>
I20260811 04:52:26.878947 5612 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:26.879010 5612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:26.879237 5612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:26.881352 5612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "abe5861814c84db7a07d7a08a8cb967f"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ea45f3c472370d0fb9b3e5060541b7eb"
server_key_iv: "51ca0060bd1f0a53663d10a64c4f64af"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.882036 5612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "abe5861814c84db7a07d7a08a8cb967f"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ea45f3c472370d0fb9b3e5060541b7eb"
server_key_iv: "51ca0060bd1f0a53663d10a64c4f64af"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.886058 5612 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:52:26.888780 5629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.890204 5612 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:26.890332 5612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "abe5861814c84db7a07d7a08a8cb967f"
format_stamp: "Formatted at 2026-08-11 04:52:26 on dist-test-slave-njxd"
server_key: "ea45f3c472370d0fb9b3e5060541b7eb"
server_key_iv: "51ca0060bd1f0a53663d10a64c4f64af"
server_key_version: "encryptionkey@0"
I20260811 04:52:26.890450 5612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:26.911782 5612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:26.912506 5612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:26.912729 5612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:26.913362 5612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:26.914345 5612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:26.914393 5612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.914465 5612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:26.914502 5612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:26.923789 5612 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:44831
I20260811 04:52:26.923892 5759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:44831 every 8 connection(s)
I20260811 04:52:26.924824 5612 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:26.927102 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5612
I20260811 04:52:26.927230 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:26.927556 18161 external_mini_cluster.cc:1428] Setting key c06fd9ee581d27259399cf2c2f6b9dc1
I20260811 04:52:26.934958 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.926853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:57369 (local address 127.17.188.126:42109)
0811 04:52:26.927002 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.927006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.928555 (+ 1549us) server_negotiation.cc:407] Connection header received
0811 04:52:26.930291 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.930294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.930347 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.930425 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:26.931296 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.931841 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.932997 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.933218 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.933331 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.934432 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:26.934436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:26.934438 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:26.934459 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:26.934478 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:26.934485 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:26.934587 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.934750 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.934814 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:52:26.935796 5762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.927484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:42109 (local address 127.17.188.67:57369)
0811 04:52:26.928402 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.928460 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.930084 (+ 1624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.930596 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.930602 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.930685 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:26.931155 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.931167 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.931979 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.931982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.932858 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.932867 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.933371 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.933375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.933540 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.934177 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:26.934179 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:26.934219 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:26.934280 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:26.934587 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:26.934599 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:26.934609 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.934748 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.935030 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":171,"threads_started":1}
I20260811 04:52:26.936913 5760 heartbeater.cc:347] Connected to a master server at 127.17.188.126:42109
I20260811 04:52:26.937132 5760 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:26.937647 5760 heartbeater.cc:511] Master 127.17.188.126:42109 requested a full tablet report, sending...
I20260811 04:52:26.938652 5234 ts_manager.cc:194] Registered new tserver with Master: abe5861814c84db7a07d7a08a8cb967f (127.17.188.67:44831)
I20260811 04:52:26.939193 5234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.67:57369
I20260811 04:52:26.941763 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:26.947304 5280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.943778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57994 (local address 127.17.188.126:42109)
0811 04:52:26.943900 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.943904 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.944125 (+ 221us) server_negotiation.cc:407] Connection header received
0811 04:52:26.944237 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.944239 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.944277 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.944346 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:26.944597 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.945087 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.945898 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.946106 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.946189 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.946937 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:26.946939 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:26.946941 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:26.946953 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:26.946972 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:26.946980 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:26.947038 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.947140 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.947194 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:52:26.950105 5234 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:26.953145 5234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:26.968394 5777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.962191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38212 (local address 127.17.188.67:44831)
0811 04:52:26.963661 (+ 1470us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.963672 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.963733 (+ 61us) server_negotiation.cc:407] Connection header received
0811 04:52:26.963812 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.963820 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.963999 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.964182 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:26.964543 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.965765 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.967145 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.967670 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.967801 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.968008 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.968120 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.968229 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1357,"thread_start_us":154,"threads_started":1}
I20260811 04:52:26.968389 5776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.962058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44831 (local address 127.0.0.1:38212)
0811 04:52:26.962570 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.962619 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.962766 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.964170 (+ 1404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.964172 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.964190 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:26.964395 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.964404 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.965891 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.965894 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.967011 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.967018 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.967800 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.967804 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.967914 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.967951 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.968088 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.968220 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":42,"thread_start_us":80,"threads_started":1}
I20260811 04:52:26.968758 5774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.962172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:42155 (local address 127.0.0.1:55782)
0811 04:52:26.962743 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.962782 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.962876 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.964142 (+ 1266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.964148 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.964172 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:26.964375 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.964383 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.965560 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.965566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.966986 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.966998 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.968331 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.968335 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.968424 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.968449 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.968534 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.968632 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":55,"thread_start_us":134,"threads_started":1}
I20260811 04:52:26.969355 5778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.962809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35575 (local address 127.0.0.1:60226)
0811 04:52:26.963297 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:26.963311 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:26.963398 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:26.964935 (+ 1537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:26.964938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:26.964957 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:26.965043 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.965049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.966454 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.966457 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.967563 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:26.967573 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.968986 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.968990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:26.969073 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.969110 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 04:52:26.969162 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 04:52:26.969227 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":95,"threads_started":1}
I20260811 04:52:26.969461 5780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.963248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55782 (local address 127.17.188.66:42155)
0811 04:52:26.963570 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.963592 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.963638 (+ 46us) server_negotiation.cc:407] Connection header received
0811 04:52:26.963726 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.963732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.963974 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.964138 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:26.964510 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.965443 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.967124 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.967956 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.968094 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.968271 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.968940 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.969041 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":132,"threads_started":1}
I20260811 04:52:26.970032 5779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:26.963025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60226 (local address 127.17.188.65:35575)
0811 04:52:26.964479 (+ 1454us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:26.964493 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:26.964518 (+ 25us) server_negotiation.cc:407] Connection header received
0811 04:52:26.964594 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:26.964602 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:26.964780 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:26.964933 (+ 153us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:26.965175 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.966331 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.967719 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:26.968854 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:26.969527 (+ 673us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:26.969744 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:26.969793 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 04:52:26.969882 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1329,"thread_start_us":158,"threads_started":1}
I20260811 04:52:26.971511 5684 tablet_service.cc:1467] Processing CreateTablet for tablet bc4e093a6adc49ecb1d942d067c757cb (DEFAULT_TABLE table=test-table [id=0d9c1daedfe945b59fad97e5f11c1a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:26.972610 5684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4e093a6adc49ecb1d942d067c757cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:26.972739 5374 tablet_service.cc:1467] Processing CreateTablet for tablet bc4e093a6adc49ecb1d942d067c757cb (DEFAULT_TABLE table=test-table [id=0d9c1daedfe945b59fad97e5f11c1a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:26.972739 5521 tablet_service.cc:1467] Processing CreateTablet for tablet bc4e093a6adc49ecb1d942d067c757cb (DEFAULT_TABLE table=test-table [id=0d9c1daedfe945b59fad97e5f11c1a09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:26.973860 5521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4e093a6adc49ecb1d942d067c757cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:26.973860 5374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc4e093a6adc49ecb1d942d067c757cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:26.979660 5781 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Bootstrap starting.
I20260811 04:52:26.981154 5782 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Bootstrap starting.
I20260811 04:52:26.982184 5781 tablet_bootstrap.cc:654] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:26.982154 5783 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Bootstrap starting.
I20260811 04:52:26.983193 5781 log.cc:824] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:26.983451 5782 tablet_bootstrap.cc:654] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:26.983980 5783 tablet_bootstrap.cc:654] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:26.984233 5782 log.cc:824] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:26.984756 5783 log.cc:824] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:26.985498 5781 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: No bootstrap required, opened a new log
I20260811 04:52:26.985757 5781 ts_tablet_manager.cc:1397] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:52:26.986600 5783 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: No bootstrap required, opened a new log
I20260811 04:52:26.986832 5783 ts_tablet_manager.cc:1397] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 04:52:26.987115 5782 tablet_bootstrap.cc:492] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: No bootstrap required, opened a new log
I20260811 04:52:26.987327 5782 ts_tablet_manager.cc:1397] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:26.989482 5781 raft_consensus.cc:348] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.989835 5781 raft_consensus.cc:374] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:26.989892 5781 raft_consensus.cc:729] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abe5861814c84db7a07d7a08a8cb967f, State: Initialized, Role: FOLLOWER
I20260811 04:52:26.990347 5781 consensus_queue.cc:260] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.991034 5760 heartbeater.cc:503] Master 127.17.188.126:42109 was elected leader, sending a full tablet report...
I20260811 04:52:26.991219 5783 raft_consensus.cc:348] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.991400 5781 ts_tablet_manager.cc:1428] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 04:52:26.991460 5783 raft_consensus.cc:374] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:26.991518 5783 raft_consensus.cc:729] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330990faece746f0940b9f340cd069b2, State: Initialized, Role: FOLLOWER
I20260811 04:52:26.991796 5782 raft_consensus.cc:348] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.992063 5782 raft_consensus.cc:374] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:26.992132 5782 raft_consensus.cc:729] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ecbae89a064ae39bd6403344430d55, State: Initialized, Role: FOLLOWER
I20260811 04:52:26.992528 5783 consensus_queue.cc:260] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.992528 5782 consensus_queue.cc:260] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:26.993453 5608 heartbeater.cc:503] Master 127.17.188.126:42109 was elected leader, sending a full tablet report...
I20260811 04:52:26.993518 5783 ts_tablet_manager.cc:1428] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 04:52:26.993518 5782 ts_tablet_manager.cc:1428] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:52:26.993861 5452 heartbeater.cc:503] Master 127.17.188.126:42109 was elected leader, sending a full tablet report...
I20260811 04:52:27.022022 5788 raft_consensus.cc:482] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:27.022228 5788 raft_consensus.cc:504] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:27.023550 5788 leader_election.cc:288] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abe5861814c84db7a07d7a08a8cb967f (127.17.188.67:44831), 330990faece746f0940b9f340cd069b2 (127.17.188.65:35575)
I20260811 04:52:27.027205 5611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.023716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:44831 (local address 127.17.188.66:44515)
0811 04:52:27.023937 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:27.023953 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:27.024048 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:27.024398 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:27.024401 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:27.024419 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:27.024542 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:27.024548 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.025301 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.025306 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:27.026131 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:27.026141 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.026777 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.026781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:27.026879 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:27.026906 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 04:52:27.026994 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 04:52:27.027070 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 04:52:27.027205 5777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.023867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:44515 (local address 127.17.188.67:44831)
0811 04:52:27.024001 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:27.024006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:27.024021 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:52:27.024238 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:27.024243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:27.024297 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:27.024370 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:27.024679 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.025183 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.026263 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.026651 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.026785 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:27.026837 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:27.027021 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 04:52:27.027089 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:52:27.027431 5790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.023809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35575 (local address 127.17.188.66:43161)
0811 04:52:27.024254 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:27.024269 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:27.024418 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:27.024700 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:27.024703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:27.024719 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:27.024842 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:27.024848 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.025556 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.025559 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:27.026349 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:27.026357 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.027005 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.027008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:27.027111 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:27.027128 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 04:52:27.027217 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 04:52:27.027283 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":139,"threads_started":1}
I20260811 04:52:27.027416 5779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.024001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:43161 (local address 127.17.188.65:35575)
0811 04:52:27.024145 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:27.024162 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:27.024340 (+ 178us) server_negotiation.cc:407] Connection header received
0811 04:52:27.024530 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:27.024533 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:27.024587 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:27.024686 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:27.024948 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.025440 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.026474 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.026859 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.026997 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:27.027044 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:27.027234 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 04:52:27.027303 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 04:52:27.027931 5707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4e093a6adc49ecb1d942d067c757cb" candidate_uuid: "e2ecbae89a064ae39bd6403344430d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe5861814c84db7a07d7a08a8cb967f" is_pre_election: true
I20260811 04:52:27.027981 5398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4e093a6adc49ecb1d942d067c757cb" candidate_uuid: "e2ecbae89a064ae39bd6403344430d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330990faece746f0940b9f340cd069b2" is_pre_election: true
I20260811 04:52:27.028264 5707 raft_consensus.cc:2454] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ecbae89a064ae39bd6403344430d55 in term 0.
I20260811 04:52:27.028275 5398 raft_consensus.cc:2454] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2ecbae89a064ae39bd6403344430d55 in term 0.
I20260811 04:52:27.028765 5473 leader_election.cc:302] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330990faece746f0940b9f340cd069b2, e2ecbae89a064ae39bd6403344430d55; no voters:
I20260811 04:52:27.029075 5788 raft_consensus.cc:2781] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:27.029161 5788 raft_consensus.cc:482] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:27.029219 5788 raft_consensus.cc:3037] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:27.030331 5788 raft_consensus.cc:504] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:27.030680 5788 leader_election.cc:288] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [CANDIDATE]: Term 1 election: Requested vote from peers abe5861814c84db7a07d7a08a8cb967f (127.17.188.67:44831), 330990faece746f0940b9f340cd069b2 (127.17.188.65:35575)
I20260811 04:52:27.031032 5707 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4e093a6adc49ecb1d942d067c757cb" candidate_uuid: "e2ecbae89a064ae39bd6403344430d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abe5861814c84db7a07d7a08a8cb967f"
I20260811 04:52:27.031073 5398 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc4e093a6adc49ecb1d942d067c757cb" candidate_uuid: "e2ecbae89a064ae39bd6403344430d55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330990faece746f0940b9f340cd069b2"
I20260811 04:52:27.031170 5707 raft_consensus.cc:3037] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:27.031196 5398 raft_consensus.cc:3037] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:27.032514 5398 raft_consensus.cc:2454] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ecbae89a064ae39bd6403344430d55 in term 1.
I20260811 04:52:27.032511 5707 raft_consensus.cc:2454] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2ecbae89a064ae39bd6403344430d55 in term 1.
I20260811 04:52:27.032856 5473 leader_election.cc:302] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330990faece746f0940b9f340cd069b2, e2ecbae89a064ae39bd6403344430d55; no voters:
I20260811 04:52:27.033026 5788 raft_consensus.cc:2781] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:27.033277 5788 raft_consensus.cc:686] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 1 LEADER]: Becoming Leader. State: Replica: e2ecbae89a064ae39bd6403344430d55, State: Running, Role: LEADER
I20260811 04:52:27.033874 5788 consensus_queue.cc:237] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } }
I20260811 04:52:27.037241 5233 catalog_manager.cc:5495] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2ecbae89a064ae39bd6403344430d55 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "e2ecbae89a064ae39bd6403344430d55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2ecbae89a064ae39bd6403344430d55" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 } health_report { overall_health: UNKNOWN } } }
W20260811 04:52:27.040414 5453 tablet.cc:2369] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:27.048211 5780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.044801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55784 (local address 127.17.188.66:42155)
0811 04:52:27.044931 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:27.044935 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:27.044948 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:52:27.045063 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:27.045065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:27.045118 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:27.045214 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:27.045425 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.045980 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.046801 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:27.047005 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:27.047080 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:27.047357 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:27.047772 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:27.047862 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:27.047932 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 04:52:27.047979 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:52:27.054292 5398 raft_consensus.cc:1261] T bc4e093a6adc49ecb1d942d067c757cb P 330990faece746f0940b9f340cd069b2 [term 1 FOLLOWER]: Refusing update from remote peer e2ecbae89a064ae39bd6403344430d55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:27.054294 5707 raft_consensus.cc:1261] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 1 FOLLOWER]: Refusing update from remote peer e2ecbae89a064ae39bd6403344430d55: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:27.055107 5791 consensus_queue.cc:1035] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abe5861814c84db7a07d7a08a8cb967f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 44831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:27.055307 5788 consensus_queue.cc:1035] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330990faece746f0940b9f340cd069b2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 35575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:27.071777 5233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:27.071988 5233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:27.075091 5233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ac3454895a3d4727b10fe0c7a932b7bb: Sending DeleteTablet for 3 replicas of tablet bc4e093a6adc49ecb1d942d067c757cb
I20260811 04:52:27.075917 5684 tablet_service.cc:1514] Processing DeleteTablet for tablet bc4e093a6adc49ecb1d942d067c757cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:27 UTC) from {username='slave'} at 127.0.0.1:38212
I20260811 04:52:27.076531 5806 tablet_replica.cc:330] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: stopping tablet replica
I20260811 04:52:27.076496 5374 tablet_service.cc:1514] Processing DeleteTablet for tablet bc4e093a6adc49ecb1d942d067c757cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:27 UTC) from {username='slave'} at 127.0.0.1:60226
I20260811 04:52:27.077369 5806 raft_consensus.cc:2229] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:27.077798 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5304
I20260811 04:52:27.078073 5806 raft_consensus.cc:2258] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:27.079597 5521 tablet_service.cc:1514] Processing DeleteTablet for tablet bc4e093a6adc49ecb1d942d067c757cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:27 UTC) from {username='slave'} at 127.0.0.1:55782
I20260811 04:52:27.080508 5808 tablet_replica.cc:330] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: stopping tablet replica
I20260811 04:52:27.080852 5808 raft_consensus.cc:2229] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:52:27.081254 5808 raft_consensus.cc:2258] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:27.082072 5806 ts_tablet_manager.cc:1905] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:27.083894 5808 ts_tablet_manager.cc:1905] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:27.085351 5806 ts_tablet_manager.cc:1918] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:27.085556 5806 log.cc:1196] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/bc4e093a6adc49ecb1d942d067c757cb
I20260811 04:52:27.086007 5806 ts_tablet_manager.cc:1939] T bc4e093a6adc49ecb1d942d067c757cb P abe5861814c84db7a07d7a08a8cb967f: Deleting consensus metadata
I20260811 04:52:27.086865 5808 ts_tablet_manager.cc:1918] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:27.086973 5808 log.cc:1196] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/bc4e093a6adc49ecb1d942d067c757cb
I20260811 04:52:27.087316 5808 ts_tablet_manager.cc:1939] T bc4e093a6adc49ecb1d942d067c757cb P e2ecbae89a064ae39bd6403344430d55: Deleting consensus metadata
I20260811 04:52:27.088040 5220 catalog_manager.cc:4841] TS abe5861814c84db7a07d7a08a8cb967f (127.17.188.67:44831): tablet bc4e093a6adc49ecb1d942d067c757cb (table test-table [id=0d9c1daedfe945b59fad97e5f11c1a09]) successfully deleted
I20260811 04:52:27.088441 5219 catalog_manager.cc:4841] TS e2ecbae89a064ae39bd6403344430d55 (127.17.188.66:42155): tablet bc4e093a6adc49ecb1d942d067c757cb (table test-table [id=0d9c1daedfe945b59fad97e5f11c1a09]) successfully deleted
W20260811 04:52:27.095033 5219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:35575 (error 108)
I20260811 04:52:27.095293 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5455
I20260811 04:52:27.098083 5778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:27.097026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:35575 (local address 127.0.0.1:60236)
0811 04:52:27.097923 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:27.097995 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:35575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":804}
W20260811 04:52:27.098284 5219 catalog_manager.cc:4584] TS 330990faece746f0940b9f340cd069b2 (127.17.188.65:35575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bc4e093a6adc49ecb1d942d067c757cb: Network error: Client connection negotiation failed: client connection to 127.17.188.65:35575: connect: Connection refused (error 111)
I20260811 04:52:27.103310 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5612
I20260811 04:52:27.110718 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5199
2026-08-11T04:52:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1066 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:27 dist-test-slave-njxd krb5kdc[5812](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:27 dist-test-slave-njxd krb5kdc[5812](info): set up 2 sockets
Aug 11 04:52:27 dist-test-slave-njxd krb5kdc[5812](info): commencing operation
krb5kdc: starting...
W20260811 04:52:28.202600 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:28.326382 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39203
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:39203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:28.441351 5827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:28.441715 5827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:28.441794 5827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:28.446056 5827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:28.446120 5827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:28.446141 5827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:28.446183 5827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:28.446214 5827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:28.451826 5827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:39203
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:28.453002 5827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:28.454185 5827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:28.462877 5834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.462934 5837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.462880 5835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:28.463038 5827 server_base.cc:1034] running on GCE node
I20260811 04:52:28.463956 5827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:28.465031 5827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:28.466207 5827 hybrid_clock.cc:648] HybridClock initialized: now 1786423948466174 us; error 43 us; skew 500 ppm
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:28.469053 5827 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:28.470052 5827 webserver.cc:460] Webserver started at http://127.17.188.126:34711/ using document root <none> and password file <none>
I20260811 04:52:28.470618 5827 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:28.470686 5827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:28.470913 5827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:28.472990 5827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "3cb664c1697f4a9fa06cc4e57433ba8a"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "79c4ca8cb11d7cc3d1a0f1bf8a0b83ca"
server_key_iv: "91e719671a0086b21e61bed6b1cea28e"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.473564 5827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "3cb664c1697f4a9fa06cc4e57433ba8a"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "79c4ca8cb11d7cc3d1a0f1bf8a0b83ca"
server_key_iv: "91e719671a0086b21e61bed6b1cea28e"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.477444 5827 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 04:52:28.479947 5845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:28.481240 5827 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:28.481375 5827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "3cb664c1697f4a9fa06cc4e57433ba8a"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "79c4ca8cb11d7cc3d1a0f1bf8a0b83ca"
server_key_iv: "91e719671a0086b21e61bed6b1cea28e"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.481490 5827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:28.518599 5827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:28.521773 5827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:28.521983 5827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:28.529157 5827 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:39203
I20260811 04:52:28.529192 5905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:39203 every 8 connection(s)
I20260811 04:52:28.530177 5827 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:28.532920 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5827
I20260811 04:52:28.533073 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:28.533067 5908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:28.533448 18161 external_mini_cluster.cc:1428] Setting key 53eee0a69b3756e9fb8adb95a021a9e0
I20260811 04:52:28.539608 5908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: Bootstrap starting.
I20260811 04:52:28.542122 5908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: Neither blocks nor log segments found. Creating new log.
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:28.543059 5908 log.cc:824] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:28.545235 5908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: No bootstrap required, opened a new log
I20260811 04:52:28.547863 5911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:28.534943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57324 (local address 127.17.188.126:39203)
0811 04:52:28.535402 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:28.535416 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:28.535452 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:52:28.536062 (+ 610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:28.536079 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:28.536405 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:28.536740 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:28.537622 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.538662 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.539539 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.540075 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.540256 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:28.543092 (+ 2836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:28.543098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:28.543111 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:28.543159 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:28.544884 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:28.545434 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:28.545439 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:28.545443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:28.545555 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:28.545905 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:28.545907 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:28.545908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:28.546383 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:28.546536 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:28.546845 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 04:52:28.547142 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":322,"thread_start_us":164,"threads_started":1}
I20260811 04:52:28.549218 5908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } }
I20260811 04:52:28.549427 5908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:28.549487 5908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cb664c1697f4a9fa06cc4e57433ba8a, State: Initialized, Role: FOLLOWER
I20260811 04:52:28.549930 5908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } }
I20260811 04:52:28.550086 5908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:28.550156 5908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:28.550290 5908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:28.551191 5908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } }
I20260811 04:52:28.551532 5908 leader_election.cc:302] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cb664c1697f4a9fa06cc4e57433ba8a; no voters:
I20260811 04:52:28.551882 5908 leader_election.cc:288] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:28.551972 5913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:28.552170 5913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [term 1 LEADER]: Becoming Leader. State: Replica: 3cb664c1697f4a9fa06cc4e57433ba8a, State: Running, Role: LEADER
I20260811 04:52:28.552465 5913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } }
I20260811 04:52:28.553196 5908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:28.554275 5917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } } }
I20260811 04:52:28.554418 5917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:28.554500 5915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cb664c1697f4a9fa06cc4e57433ba8a. Latest consensus state: current_term: 1 leader_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cb664c1697f4a9fa06cc4e57433ba8a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39203 } } }
I20260811 04:52:28.554627 5915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:28.555639 5925 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:28.558509 5925 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:28.564484 5925 catalog_manager.cc:1347] Generated new cluster ID: 8368d9932524442a88bb434cc958ab26
I20260811 04:52:28.564566 5925 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:28.573972 5925 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:28.574918 5925 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:28.580996 5925 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: Generated new TSK 0
I20260811 04:52:28.581775 5925 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:52:28.616530 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:28.731985 5937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:28.732281 5937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:28.732354 5937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:28.736411 5937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:28.736491 5937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:28.736577 5937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:28.741750 5937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:28.742827 5937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:28.743839 5937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:28.753297 5946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.753297 5944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.753335 5943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:28.753731 5937 server_base.cc:1034] running on GCE node
I20260811 04:52:28.754172 5937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:28.754863 5937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:28.756050 5937 hybrid_clock.cc:648] HybridClock initialized: now 1786423948756028 us; error 33 us; skew 500 ppm
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:28.763864 5937 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:52:28.764794 5937 webserver.cc:460] Webserver started at http://127.17.188.65:35425/ using document root <none> and password file <none>
I20260811 04:52:28.765375 5937 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:28.765435 5937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:28.765733 5937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:28.767702 5937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "05cf47f65abe4d6ea333824094eb53a3"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "0e65d7f2830fd9c16b4e857a7c0da37b"
server_key_iv: "e31b0a7395d2f3fdff74cd047af7d46a"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.768249 5937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "05cf47f65abe4d6ea333824094eb53a3"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "0e65d7f2830fd9c16b4e857a7c0da37b"
server_key_iv: "e31b0a7395d2f3fdff74cd047af7d46a"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.771879 5937 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:28.774411 5955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:28.775615 5937 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:28.775744 5937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "05cf47f65abe4d6ea333824094eb53a3"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "0e65d7f2830fd9c16b4e857a7c0da37b"
server_key_iv: "e31b0a7395d2f3fdff74cd047af7d46a"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.775856 5937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:28.791174 5937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:28.794456 5937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:28.794685 5937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:28.795261 5937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:28.796073 5937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:28.796119 5937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:28.796190 5937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:28.796221 5937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:28.805127 5937 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:34791
I20260811 04:52:28.805169 6079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:34791 every 8 connection(s)
I20260811 04:52:28.806049 5937 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:28.814458 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 5937
I20260811 04:52:28.814666 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:28.815028 18161 external_mini_cluster.cc:1428] Setting key 244ffdd8a925f3eb4164af5056278951
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:28.819854 5911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:28.807811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:33293 (local address 127.17.188.126:39203)
0811 04:52:28.807964 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:28.807968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:28.808783 (+ 815us) server_negotiation.cc:407] Connection header received
0811 04:52:28.810125 (+ 1342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:28.810128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:28.810178 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:28.810250 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:28.811323 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.811837 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.812933 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.813163 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.813251 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:28.815903 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:28.815905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:28.815907 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:28.815932 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:28.817519 (+ 1587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:28.818179 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:28.818181 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:28.818183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:28.818256 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:28.818679 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:28.818684 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:28.818687 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:28.818931 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:28.819037 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:28.819491 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 04:52:28.819631 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:52:28.820595 6083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:28.808165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:39203 (local address 127.17.188.65:33293)
0811 04:52:28.808624 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:28.808671 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:28.809927 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:28.810407 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:28.810414 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:28.810747 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:28.811197 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:28.811210 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.811945 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.811948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:28.812831 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:28.812839 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:28.813300 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:28.813303 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:28.813442 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:28.814000 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:28.814016 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:28.815722 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:28.817673 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:28.817682 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:28.817699 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:28.818070 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:28.818344 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:28.818350 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:28.818355 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:28.818548 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:28.819038 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:28.819043 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:28.819260 (+ 217us) client_negotiation.cc:769] Sending connection context
0811 04:52:28.819410 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 04:52:28.819646 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":150,"threads_started":1}
I20260811 04:52:28.821899 6080 heartbeater.cc:347] Connected to a master server at 127.17.188.126:39203
I20260811 04:52:28.822155 6080 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:28.822625 6080 heartbeater.cc:511] Master 127.17.188.126:39203 requested a full tablet report, sending...
I20260811 04:52:28.824087 5863 ts_manager.cc:194] Registered new tserver with Master: 05cf47f65abe4d6ea333824094eb53a3 (127.17.188.65:34791)
I20260811 04:52:28.825204 5863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:33293
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:52:28.844043 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:28.953464 6086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:28.953830 6086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:28.953961 6086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:28.958122 6086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:28.958207 6086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:28.958300 6086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:28.963519 6086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:28.964618 6086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:28.965682 6086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:52:28.975704 6086 server_base.cc:1034] running on GCE node
W20260811 04:52:28.975790 6095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.975782 6091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:28.975728 6093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:28.976442 6086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:28.977016 6086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:28.978181 6086 hybrid_clock.cc:648] HybridClock initialized: now 1786423948978146 us; error 49 us; skew 500 ppm
Aug 11 04:52:28 dist-test-slave-njxd krb5kdc[5812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:28.981123 6086 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:52:28.982057 6086 webserver.cc:460] Webserver started at http://127.17.188.66:39633/ using document root <none> and password file <none>
I20260811 04:52:28.982630 6086 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:28.982724 6086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:28.982955 6086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:28.985090 6086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "099cad621649425e8def6f55c11c3109"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "83032d80f471347a82a77da7712dd1a5"
server_key_iv: "bbe598bcb6c805ab9341242aab56c286"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.985747 6086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "099cad621649425e8def6f55c11c3109"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "83032d80f471347a82a77da7712dd1a5"
server_key_iv: "bbe598bcb6c805ab9341242aab56c286"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.989415 6086 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:28.991945 6104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:28.993119 6086 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:28.993266 6086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "099cad621649425e8def6f55c11c3109"
format_stamp: "Formatted at 2026-08-11 04:52:28 on dist-test-slave-njxd"
server_key: "83032d80f471347a82a77da7712dd1a5"
server_key_iv: "bbe598bcb6c805ab9341242aab56c286"
server_key_version: "encryptionkey@0"
I20260811 04:52:28.993379 6086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:29.005897 6086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:29.009125 6086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:29.009336 6086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:29.009975 6086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:29.010867 6086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:29.010936 6086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.011029 6086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:29.011091 6086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.019832 6086 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:41757
I20260811 04:52:29.019894 6231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:41757 every 8 connection(s)
I20260811 04:52:29.020833 6086 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:29.021023 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6086
I20260811 04:52:29.021168 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:29.021549 18161 external_mini_cluster.cc:1428] Setting key a92907aade5b1e50a88d578d5b07fb8f
Aug 11 04:52:29 dist-test-slave-njxd krb5kdc[5812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423948, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
I20260811 04:52:29.036965 5911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.022819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:49671 (local address 127.17.188.126:39203)
0811 04:52:29.022959 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.022963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.023999 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 04:52:29.025488 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.025491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.025546 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.025660 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:29.027338 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.027854 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.029735 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.029955 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.030036 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.032955 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:29.032958 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:29.032961 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:29.032985 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:29.034648 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.035212 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.035215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.035216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.035327 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.035720 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.035722 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.035724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.035960 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:29.036099 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.036728 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.036840 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 04:52:29.038200 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.023349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:39203 (local address 127.17.188.66:49671)
0811 04:52:29.023859 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.023901 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.025274 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.025883 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.025895 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.026414 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:29.027184 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.027207 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.027995 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.028001 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.029575 (+ 1574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.029614 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.030117 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.030124 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.030395 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.031058 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:29.031084 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:29.032779 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:29.034768 (+ 1989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:29.034774 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:29.034790 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:29.035055 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:29.035428 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:29.035431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:29.035433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:29.035574 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:29.036097 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:29.036104 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:29.036445 (+ 341us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.036679 (+ 234us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.037066 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":143,"threads_started":1}
I20260811 04:52:29.039399 6232 heartbeater.cc:347] Connected to a master server at 127.17.188.126:39203
I20260811 04:52:29.039662 6232 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:29.040174 6232 heartbeater.cc:511] Master 127.17.188.126:39203 requested a full tablet report, sending...
I20260811 04:52:29.041227 5863 ts_manager.cc:194] Registered new tserver with Master: 099cad621649425e8def6f55c11c3109 (127.17.188.66:41757)
I20260811 04:52:29.041877 5863 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:49671
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:52:29.053112 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35817
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:29.165868 6239 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:29.166152 6239 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:29.166198 6239 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:29.170852 6239 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:29.170933 6239 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:29.171016 6239 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:29.176983 6239 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35817
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:39203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6239
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:29.178169 6239 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:29.179322 6239 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:29.189281 6248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:29.189294 6245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:29.189471 6239 server_base.cc:1034] running on GCE node
W20260811 04:52:29.189625 6244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:29.190025 6239 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:29.190727 6239 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:29.191939 6239 hybrid_clock.cc:648] HybridClock initialized: now 1786423949191923 us; error 24 us; skew 500 ppm
Aug 11 04:52:29 dist-test-slave-njxd krb5kdc[5812](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423949, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:29.194803 6239 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:52:29.195700 6239 webserver.cc:460] Webserver started at http://127.17.188.67:42387/ using document root <none> and password file <none>
I20260811 04:52:29.196326 6239 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:29.196445 6239 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:29.196704 6239 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:29.198956 6239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "bdc4d73202aa42ca93a90b251cb9db45"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "120e70d2eab22d00851d0851095dee2b"
server_key_iv: "d720205f3146dad3ea3eb0e9e6d16378"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.199548 6239 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "bdc4d73202aa42ca93a90b251cb9db45"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "120e70d2eab22d00851d0851095dee2b"
server_key_iv: "d720205f3146dad3ea3eb0e9e6d16378"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.203281 6239 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:29.205734 6260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.206971 6239 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:29.207109 6239 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "bdc4d73202aa42ca93a90b251cb9db45"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "120e70d2eab22d00851d0851095dee2b"
server_key_iv: "d720205f3146dad3ea3eb0e9e6d16378"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.207224 6239 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:29.222255 6239 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:29.225257 6239 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:29.225471 6239 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:29.226132 6239 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:29.227005 6239 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:29.227077 6239 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.227151 6239 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:29.227187 6239 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.236021 6239 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43553
I20260811 04:52:29.236047 6388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43553 every 8 connection(s)
I20260811 04:52:29.236912 6239 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:29.239971 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6239
I20260811 04:52:29.240108 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:29.240401 18161 external_mini_cluster.cc:1428] Setting key 38245af8c098072aaf37227b2377c401
Aug 11 04:52:29 dist-test-slave-njxd krb5kdc[5812](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423949, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:29.250499 5911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.238737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:55183 (local address 127.17.188.126:39203)
0811 04:52:29.238880 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.238884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.239614 (+ 730us) server_negotiation.cc:407] Connection header received
0811 04:52:29.241174 (+ 1560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.241177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.241242 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.241334 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:29.242974 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.243505 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.244592 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.244817 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.244893 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.247270 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:29.247273 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:29.247275 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:29.247300 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:29.248641 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.249101 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.249103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.249104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.249186 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.249490 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.249492 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.249493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.249725 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:29.249823 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.250271 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.250374 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:52:29.251371 6391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.239027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:39203 (local address 127.17.188.67:55183)
0811 04:52:29.239458 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.239498 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.240952 (+ 1454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.241565 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.241572 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.242153 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:29.242827 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.242847 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.243609 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.243611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.244478 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.244499 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.244942 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.244944 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.245090 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.245661 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:29.245678 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:29.247115 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:29.248750 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:29.248754 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:29.248766 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:29.249013 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:29.249265 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:29.249267 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:29.249268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:29.249396 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:29.249832 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:29.249837 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:29.250067 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.250223 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.250477 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":113,"threads_started":1}
I20260811 04:52:29.252573 6389 heartbeater.cc:347] Connected to a master server at 127.17.188.126:39203
I20260811 04:52:29.252826 6389 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:29.253432 6389 heartbeater.cc:511] Master 127.17.188.126:39203 requested a full tablet report, sending...
I20260811 04:52:29.254717 5862 ts_manager.cc:194] Registered new tserver with Master: bdc4d73202aa42ca93a90b251cb9db45 (127.17.188.67:43553)
I20260811 04:52:29.255409 5862 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:55183
I20260811 04:52:29.266675 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:29.276388 5911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.268688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57338 (local address 127.17.188.126:39203)
0811 04:52:29.268842 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.268853 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.268964 (+ 111us) server_negotiation.cc:407] Connection header received
0811 04:52:29.269069 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.269071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.269112 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.269198 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:29.269909 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.270440 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.271316 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.271516 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.271593 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.273244 (+ 1651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:29.273247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:29.273249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:29.273270 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:29.274674 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.275155 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.275157 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.275159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.275234 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:29.275503 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:29.275506 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:29.275507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:29.275706 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:29.275835 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.276076 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.276198 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:52:29.279639 5862 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:29.282773 5862 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:29.297087 6403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.290980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43553 (local address 127.0.0.1:58326)
0811 04:52:29.291316 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.291361 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.291490 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.292791 (+ 1301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.292799 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.292825 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:29.293002 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.293009 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.294294 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.294300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.295566 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.295575 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.296519 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.296522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.296665 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.296713 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.296817 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.296935 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":92,"threads_started":1}
I20260811 04:52:29.297168 6409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.291890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58326 (local address 127.17.188.67:43553)
0811 04:52:29.292274 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.292287 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.292314 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:52:29.292392 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.292398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.292612 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.292791 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:29.293142 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.294171 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.295690 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.296391 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.296497 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.296645 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.296868 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.297019 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":129,"threads_started":1}
I20260811 04:52:29.297659 6406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.291047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:41757 (local address 127.0.0.1:34168)
0811 04:52:29.292775 (+ 1728us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.292788 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.292881 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.293346 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.293348 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.293367 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:29.293476 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.293482 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.295050 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.295054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.295986 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.295996 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.297223 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.297227 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.297334 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.297361 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.297440 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.297510 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1662,"mutex_wait_us":78,"thread_start_us":122,"threads_started":1}
I20260811 04:52:29.297734 6410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.292377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.17.188.66:41757)
0811 04:52:29.292693 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.292701 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.292875 (+ 174us) server_negotiation.cc:407] Connection header received
0811 04:52:29.292987 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.292993 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.293217 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.293364 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:29.293596 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.294891 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.296116 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.296916 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.297019 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.297153 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.297485 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.297604 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":127,"threads_started":1}
I20260811 04:52:29.298626 6404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.291399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:34791 (local address 127.0.0.1:48090)
0811 04:52:29.293050 (+ 1651us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.293060 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.293200 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.293628 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.293631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.293648 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:29.293736 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.293740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.295050 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.295054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.296867 (+ 1813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.296876 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.298251 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.298254 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.298347 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.298369 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.298438 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.298502 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1602,"mutex_wait_us":831,"thread_start_us":121,"threads_started":1}
I20260811 04:52:29.299057 6407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.291830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.17.188.65:34791)
0811 04:52:29.292157 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.292174 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.293171 (+ 997us) server_negotiation.cc:407] Connection header received
0811 04:52:29.293308 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.293317 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.293490 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.293657 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:29.293820 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.294911 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.296991 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.297948 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.298024 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.298156 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.298837 (+ 681us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.298928 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":103,"threads_started":1}
I20260811 04:52:29.300101 6159 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe124f24789445ea2ae95390385de36 (DEFAULT_TABLE table=test-table [id=5de860e33a1546daa0df6f2ec2a0413e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:29.300330 6317 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe124f24789445ea2ae95390385de36 (DEFAULT_TABLE table=test-table [id=5de860e33a1546daa0df6f2ec2a0413e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:29.301004 6159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe124f24789445ea2ae95390385de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:29.301317 6317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe124f24789445ea2ae95390385de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:29.301420 6008 tablet_service.cc:1467] Processing CreateTablet for tablet 9fe124f24789445ea2ae95390385de36 (DEFAULT_TABLE table=test-table [id=5de860e33a1546daa0df6f2ec2a0413e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:29.302379 6008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fe124f24789445ea2ae95390385de36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:29.308198 6411 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Bootstrap starting.
I20260811 04:52:29.309607 6413 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Bootstrap starting.
I20260811 04:52:29.310547 6414 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: Bootstrap starting.
I20260811 04:52:29.310639 6411 tablet_bootstrap.cc:654] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:29.311931 6413 tablet_bootstrap.cc:654] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:29.312049 6411 log.cc:824] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:29.312944 6414 tablet_bootstrap.cc:654] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:29.313225 6413 log.cc:824] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:29.314226 6414 log.cc:824] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:29.314414 6411 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: No bootstrap required, opened a new log
I20260811 04:52:29.314657 6411 ts_tablet_manager.cc:1397] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 04:52:29.315116 6413 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: No bootstrap required, opened a new log
I20260811 04:52:29.315301 6413 ts_tablet_manager.cc:1397] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:29.316218 6414 tablet_bootstrap.cc:492] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: No bootstrap required, opened a new log
I20260811 04:52:29.316398 6414 ts_tablet_manager.cc:1397] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:29.318523 6413 raft_consensus.cc:348] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.318554 6411 raft_consensus.cc:348] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.318768 6413 raft_consensus.cc:374] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:29.318818 6413 raft_consensus.cc:729] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdc4d73202aa42ca93a90b251cb9db45, State: Initialized, Role: FOLLOWER
I20260811 04:52:29.318818 6411 raft_consensus.cc:374] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:29.318866 6411 raft_consensus.cc:729] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099cad621649425e8def6f55c11c3109, State: Initialized, Role: FOLLOWER
I20260811 04:52:29.319253 6413 consensus_queue.cc:260] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.319308 6411 consensus_queue.cc:260] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.319900 6389 heartbeater.cc:503] Master 127.17.188.126:39203 was elected leader, sending a full tablet report...
I20260811 04:52:29.320199 6413 ts_tablet_manager.cc:1428] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:52:29.320106 6414 raft_consensus.cc:348] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.320349 6414 raft_consensus.cc:374] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:29.320415 6414 raft_consensus.cc:729] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05cf47f65abe4d6ea333824094eb53a3, State: Initialized, Role: FOLLOWER
I20260811 04:52:29.320791 6414 consensus_queue.cc:260] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.321367 6411 ts_tablet_manager.cc:1428] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 04:52:29.321533 6080 heartbeater.cc:503] Master 127.17.188.126:39203 was elected leader, sending a full tablet report...
I20260811 04:52:29.321698 6232 heartbeater.cc:503] Master 127.17.188.126:39203 was elected leader, sending a full tablet report...
I20260811 04:52:29.322625 6414 ts_tablet_manager.cc:1428] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:52:29.435093 6419 raft_consensus.cc:482] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:29.435305 6419 raft_consensus.cc:504] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.436443 6419 leader_election.cc:288] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bdc4d73202aa42ca93a90b251cb9db45 (127.17.188.67:43553), 05cf47f65abe4d6ea333824094eb53a3 (127.17.188.65:34791)
I20260811 04:52:29.441670 6409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.436997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:60757 (local address 127.17.188.67:43553)
0811 04:52:29.437172 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.437179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.437678 (+ 499us) server_negotiation.cc:407] Connection header received
0811 04:52:29.437739 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.437741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.437812 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.437895 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:29.438129 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.438823 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.440334 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.440943 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.441075 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.441140 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.441433 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.441508 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 04:52:29.441670 6407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.436896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:40693 (local address 127.17.188.65:34791)
0811 04:52:29.437068 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.437074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.437094 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:52:29.437217 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.437224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.437292 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.437382 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:29.437804 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.438631 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.440334 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.440948 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.441074 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.441129 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.441433 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.441508 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:52:29.441725 6235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.436789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:34791 (local address 127.17.188.66:40693)
0811 04:52:29.436937 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.436954 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.437083 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.437409 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.437412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.437434 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:29.437689 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.437699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.438744 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.438746 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.440155 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.440168 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.441081 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.441085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.441258 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.441316 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.441398 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.441541 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":134}
I20260811 04:52:29.441926 6421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.436789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43553 (local address 127.17.188.66:60757)
0811 04:52:29.437443 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.437474 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.437643 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.437910 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.437912 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.437928 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:29.438017 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.438021 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.438918 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.438921 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.440187 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:29.440195 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.441081 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.441085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:29.441302 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.441317 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 04:52:29.441398 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 04:52:29.441541 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":594,"mutex_wait_us":375,"thread_start_us":179,"threads_started":1}
I20260811 04:52:29.442482 6029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe124f24789445ea2ae95390385de36" candidate_uuid: "099cad621649425e8def6f55c11c3109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cf47f65abe4d6ea333824094eb53a3" is_pre_election: true
I20260811 04:52:29.442663 6338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe124f24789445ea2ae95390385de36" candidate_uuid: "099cad621649425e8def6f55c11c3109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdc4d73202aa42ca93a90b251cb9db45" is_pre_election: true
I20260811 04:52:29.442822 6029 raft_consensus.cc:2454] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099cad621649425e8def6f55c11c3109 in term 0.
I20260811 04:52:29.442965 6338 raft_consensus.cc:2454] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 099cad621649425e8def6f55c11c3109 in term 0.
I20260811 04:52:29.443377 6105 leader_election.cc:302] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cf47f65abe4d6ea333824094eb53a3, 099cad621649425e8def6f55c11c3109; no voters:
I20260811 04:52:29.443655 6419 raft_consensus.cc:2781] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:29.443796 6419 raft_consensus.cc:482] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:29.443861 6419 raft_consensus.cc:3037] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:29.445031 6419 raft_consensus.cc:504] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.445415 6419 leader_election.cc:288] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [CANDIDATE]: Term 1 election: Requested vote from peers bdc4d73202aa42ca93a90b251cb9db45 (127.17.188.67:43553), 05cf47f65abe4d6ea333824094eb53a3 (127.17.188.65:34791)
I20260811 04:52:29.445750 6338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe124f24789445ea2ae95390385de36" candidate_uuid: "099cad621649425e8def6f55c11c3109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bdc4d73202aa42ca93a90b251cb9db45"
I20260811 04:52:29.445806 6029 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fe124f24789445ea2ae95390385de36" candidate_uuid: "099cad621649425e8def6f55c11c3109" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "05cf47f65abe4d6ea333824094eb53a3"
I20260811 04:52:29.445884 6338 raft_consensus.cc:3037] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:29.445914 6029 raft_consensus.cc:3037] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:29.447199 6338 raft_consensus.cc:2454] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099cad621649425e8def6f55c11c3109 in term 1.
I20260811 04:52:29.447199 6029 raft_consensus.cc:2454] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 099cad621649425e8def6f55c11c3109 in term 1.
I20260811 04:52:29.447530 6105 leader_election.cc:302] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05cf47f65abe4d6ea333824094eb53a3, 099cad621649425e8def6f55c11c3109; no voters:
I20260811 04:52:29.447714 6419 raft_consensus.cc:2781] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:29.447956 6419 raft_consensus.cc:686] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 1 LEADER]: Becoming Leader. State: Replica: 099cad621649425e8def6f55c11c3109, State: Running, Role: LEADER
I20260811 04:52:29.448335 6419 consensus_queue.cc:237] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } }
I20260811 04:52:29.451530 5863 catalog_manager.cc:5495] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 reported cstate change: term changed from 0 to 1, leader changed from <none> to 099cad621649425e8def6f55c11c3109 (127.17.188.66). New cstate: current_term: 1 leader_uuid: "099cad621649425e8def6f55c11c3109" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "099cad621649425e8def6f55c11c3109" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 41757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 } health_report { overall_health: UNKNOWN } } }
W20260811 04:52:29.487900 6390 tablet.cc:2369] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:29.492368 6410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.488965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34184 (local address 127.17.188.66:41757)
0811 04:52:29.489089 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.489093 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.489108 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:52:29.489183 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.489185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.489241 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.489343 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:29.489598 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.490221 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.491035 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.491237 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.491310 (+ 73us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.491591 (+ 281us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:29.491993 (+ 402us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:29.492108 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.492207 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.492243 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:52:29.498255 6338 raft_consensus.cc:1261] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 1 FOLLOWER]: Refusing update from remote peer 099cad621649425e8def6f55c11c3109: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:29.498292 6029 raft_consensus.cc:1261] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3 [term 1 FOLLOWER]: Refusing update from remote peer 099cad621649425e8def6f55c11c3109: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:29.498960 6419 consensus_queue.cc:1035] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05cf47f65abe4d6ea333824094eb53a3" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:29.499169 6422 consensus_queue.cc:1035] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bdc4d73202aa42ca93a90b251cb9db45" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:29.507556 6426 mvcc.cc:205] Tried to move back new op lower bound from 7317192497137315840 to 7317192496942723072. Current Snapshot: MvccSnapshot[applied={T|T < 7317192497137315840}]
I20260811 04:52:29.507773 6427 mvcc.cc:205] Tried to move back new op lower bound from 7317192497137315840 to 7317192496942723072. Current Snapshot: MvccSnapshot[applied={T|T < 7317192497137315840}]
I20260811 04:52:29.515152 5862 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:29.515334 5862 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:29.517516 5862 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3cb664c1697f4a9fa06cc4e57433ba8a: Sending DeleteTablet for 3 replicas of tablet 9fe124f24789445ea2ae95390385de36
I20260811 04:52:29.518311 6159 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe124f24789445ea2ae95390385de36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:29 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:34168
I20260811 04:52:29.518421 6008 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe124f24789445ea2ae95390385de36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:29 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:48090
I20260811 04:52:29.518782 6317 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fe124f24789445ea2ae95390385de36 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:29 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:58326
I20260811 04:52:29.519129 6437 tablet_replica.cc:330] T 9fe124f24789445ea2ae95390385de36 P 05cf47f65abe4d6ea333824094eb53a3: stopping tablet replica
I20260811 04:52:29.519204 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5937
I20260811 04:52:29.519240 6436 tablet_replica.cc:330] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: stopping tablet replica
I20260811 04:52:29.520725 6436 raft_consensus.cc:2229] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:52:29.521057 6436 raft_consensus.cc:2258] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:29.522924 6436 ts_tablet_manager.cc:1905] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:29.523119 6438 tablet_replica.cc:330] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: stopping tablet replica
I20260811 04:52:29.523511 6438 raft_consensus.cc:2229] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:29.523875 6438 raft_consensus.cc:2258] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:29.525748 6438 ts_tablet_manager.cc:1905] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:29.525808 6436 ts_tablet_manager.cc:1918] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:29.525908 6436 log.cc:1196] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9fe124f24789445ea2ae95390385de36
I20260811 04:52:29.526264 6436 ts_tablet_manager.cc:1939] T 9fe124f24789445ea2ae95390385de36 P 099cad621649425e8def6f55c11c3109: Deleting consensus metadata
I20260811 04:52:29.528384 5849 catalog_manager.cc:4841] TS 099cad621649425e8def6f55c11c3109 (127.17.188.66:41757): tablet 9fe124f24789445ea2ae95390385de36 (table test-table [id=5de860e33a1546daa0df6f2ec2a0413e]) successfully deleted
I20260811 04:52:29.529474 6438 ts_tablet_manager.cc:1918] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:29.529662 6438 log.cc:1196] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9fe124f24789445ea2ae95390385de36
I20260811 04:52:29.530081 6438 ts_tablet_manager.cc:1939] T 9fe124f24789445ea2ae95390385de36 P bdc4d73202aa42ca93a90b251cb9db45: Deleting consensus metadata
W20260811 04:52:29.532034 5846 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:34791 (error 108)
I20260811 04:52:29.533017 6404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.532748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:34791 (local address 127.0.0.1:48106)
0811 04:52:29.532871 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.532945 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:34791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 04:52:29.533145 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6086
W20260811 04:52:29.533252 5846 catalog_manager.cc:4584] TS 05cf47f65abe4d6ea333824094eb53a3 (127.17.188.65:34791): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9fe124f24789445ea2ae95390385de36: Network error: Client connection negotiation failed: client connection to 127.17.188.65:34791: connect: Connection refused (error 111)
I20260811 04:52:29.535063 5848 catalog_manager.cc:4841] TS bdc4d73202aa42ca93a90b251cb9db45 (127.17.188.67:43553): tablet 9fe124f24789445ea2ae95390385de36 (table test-table [id=5de860e33a1546daa0df6f2ec2a0413e]) successfully deleted
I20260811 04:52:29.540127 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6239
I20260811 04:52:29.548846 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 5827
2026-08-11T04:52:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2438 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T04:52:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:29Z Disabled control of system clock
I20260811 04:52:29.581972 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35883
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:35883
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:29.692690 6443 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:29.692950 6443 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:29.692986 6443 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:29.697049 6443 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:29.697099 6443 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:29.697113 6443 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:29.697149 6443 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:29.697165 6443 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:29.701869 6443 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:35883
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35883
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6443
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:29.702919 6443 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:29.704264 6443 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:29.712536 6451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:29.712579 6454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:29.712528 6452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:29.712713 6443 server_base.cc:1034] running on GCE node
I20260811 04:52:29.713385 6443 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:29.714428 6443 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:29.715610 6443 hybrid_clock.cc:648] HybridClock initialized: now 1786423949715582 us; error 38 us; skew 500 ppm
I20260811 04:52:29.717519 6443 webserver.cc:460] Webserver started at http://127.17.188.126:37123/ using document root <none> and password file <none>
I20260811 04:52:29.718075 6443 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:29.718166 6443 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:29.718391 6443 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:29.720366 6443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "7fc9c0ce63374d43cd218c17d0957a29"
server_key_iv: "7729a09138406a6f7f77db0c1c3cd83a"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.720902 6443 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "7fc9c0ce63374d43cd218c17d0957a29"
server_key_iv: "7729a09138406a6f7f77db0c1c3cd83a"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.724526 6443 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:52:29.726842 6460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.728010 6443 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:29.728157 6443 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "7fc9c0ce63374d43cd218c17d0957a29"
server_key_iv: "7729a09138406a6f7f77db0c1c3cd83a"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.728268 6443 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:29.743914 6443 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:29.744557 6443 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:29.744755 6443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:29.751900 6443 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:35883
I20260811 04:52:29.751917 6515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:35883 every 8 connection(s)
I20260811 04:52:29.752859 6443 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:29.755868 6517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:29.757946 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6443
I20260811 04:52:29.758080 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:29.758368 18161 external_mini_cluster.cc:1428] Setting key 55e3eae4491d6769e70ba63dfabf5003
I20260811 04:52:29.762331 6517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: Bootstrap starting.
I20260811 04:52:29.764952 6517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:29.765877 6517 log.cc:824] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:29.768252 6517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: No bootstrap required, opened a new log
I20260811 04:52:29.769194 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.759850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38338 (local address 127.17.188.126:35883)
0811 04:52:29.760550 (+ 700us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.760571 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.760614 (+ 43us) server_negotiation.cc:407] Connection header received
0811 04:52:29.761467 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.761492 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.762017 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.762407 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:29.762841 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.764307 (+ 1466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.765352 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:29.766078 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:29.766262 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:29.767144 (+ 882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:29.767151 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:29.767167 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:29.767668 (+ 501us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:29.767740 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:29.767765 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:29.767862 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:29.767997 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 04:52:29.768263 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":105,"threads_started":1}
I20260811 04:52:29.772374 6517 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } }
I20260811 04:52:29.772588 6517 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:29.772622 6517 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f4f1a4d3eab47eb8d04d5f4869770c5, State: Initialized, Role: FOLLOWER
I20260811 04:52:29.773017 6517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } }
I20260811 04:52:29.773149 6517 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:29.773205 6517 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:29.773270 6517 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:29.774217 6517 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } }
I20260811 04:52:29.774506 6517 leader_election.cc:302] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f4f1a4d3eab47eb8d04d5f4869770c5; no voters:
I20260811 04:52:29.774776 6517 leader_election.cc:288] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:29.774901 6523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:29.775177 6523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f4f1a4d3eab47eb8d04d5f4869770c5, State: Running, Role: LEADER
I20260811 04:52:29.775472 6523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } }
I20260811 04:52:29.776103 6517 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:29.777242 6524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } } }
I20260811 04:52:29.777297 6525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f4f1a4d3eab47eb8d04d5f4869770c5. Latest consensus state: current_term: 1 leader_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f4f1a4d3eab47eb8d04d5f4869770c5" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35883 } } }
I20260811 04:52:29.777366 6524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:29.777396 6525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:29.777774 6534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:29.780943 6534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:29.786777 6534 catalog_manager.cc:1347] Generated new cluster ID: 29fe7c1c16dc4862b62d88a4f374dcf3
I20260811 04:52:29.786856 6534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:29.795477 6534 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:29.796612 6534 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:29.807615 6534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: Generated new TSK 0
I20260811 04:52:29.808409 6534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:29.812353 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--builtin_ntp_servers=127.17.188.84:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:29.926865 6545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:29.927124 6545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:29.927162 6545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:29.931248 6545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:29.931298 6545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:29.931352 6545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:29.936349 6545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:29.937352 6545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:29.938797 6545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:29.948464 6551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:29.948486 6555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:29.948660 6545 server_base.cc:1034] running on GCE node
W20260811 04:52:29.948772 6553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:29.949229 6545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:29.950003 6545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:29.951186 6545 hybrid_clock.cc:648] HybridClock initialized: now 1786423949951159 us; error 36 us; skew 500 ppm
I20260811 04:52:29.953100 6545 webserver.cc:460] Webserver started at http://127.17.188.65:37125/ using document root <none> and password file <none>
I20260811 04:52:29.953747 6545 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:29.953815 6545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:29.954067 6545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:29.956189 6545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "bda3b1181b914b53a7c858a06512cf6f"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "b0d4e30f2b9e5f5f5b5fe8f9e2d458a2"
server_key_iv: "792e33ebfa1cac3e7c6681e308f5e8b5"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.956791 6545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "bda3b1181b914b53a7c858a06512cf6f"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "b0d4e30f2b9e5f5f5b5fe8f9e2d458a2"
server_key_iv: "792e33ebfa1cac3e7c6681e308f5e8b5"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.960691 6545 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 04:52:29.963219 6561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.964469 6545 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:29.964610 6545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "bda3b1181b914b53a7c858a06512cf6f"
format_stamp: "Formatted at 2026-08-11 04:52:29 on dist-test-slave-njxd"
server_key: "b0d4e30f2b9e5f5f5b5fe8f9e2d458a2"
server_key_iv: "792e33ebfa1cac3e7c6681e308f5e8b5"
server_key_version: "encryptionkey@0"
I20260811 04:52:29.964738 6545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:29.981717 6545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:29.982393 6545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:29.982597 6545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:29.983180 6545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:29.984131 6545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:29.984205 6545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.984272 6545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:29.984323 6545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:29.993443 6545 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:34435
I20260811 04:52:29.993490 6687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:34435 every 8 connection(s)
I20260811 04:52:29.994357 6545 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:29.999635 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6545
I20260811 04:52:29.999776 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:30.000106 18161 external_mini_cluster.cc:1428] Setting key 9afec92501b475757175c2d3c8fe7288
I20260811 04:52:30.002053 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--builtin_ntp_servers=127.17.188.84:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:30.004153 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.996175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:42763 (local address 127.17.188.126:35883)
0811 04:52:29.996317 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:29.996320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:29.997509 (+ 1189us) server_negotiation.cc:407] Connection header received
0811 04:52:29.998967 (+ 1458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:29.998970 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:29.999029 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:29.999129 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:30.000283 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.000828 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.002081 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.002392 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.002510 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.003641 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:30.003645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:30.003648 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:30.003668 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:30.003697 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:30.003705 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:30.003786 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.003952 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.004012 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:52:30.005002 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:29.996686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35883 (local address 127.17.188.65:42763)
0811 04:52:29.997353 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:29.997394 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:29.998742 (+ 1348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:29.999303 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:29.999309 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:29.999425 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:30.000123 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.000146 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.000971 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.000975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.001949 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.001959 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.002549 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.002554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.002723 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.003375 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:30.003377 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:30.003419 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:30.003482 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:30.003789 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:30.003801 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:30.003810 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.003948 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.004241 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":122,"threads_started":1}
I20260811 04:52:30.006383 6688 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35883
I20260811 04:52:30.006630 6688 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:30.007143 6688 heartbeater.cc:511] Master 127.17.188.126:35883 requested a full tablet report, sending...
I20260811 04:52:30.008852 6479 ts_manager.cc:194] Registered new tserver with Master: bda3b1181b914b53a7c858a06512cf6f (127.17.188.65:34435)
I20260811 04:52:30.010691 6479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.65:42763
W20260811 04:52:30.115685 6692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:30.115943 6692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:30.115981 6692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:30.119995 6692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:30.120048 6692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:30.120100 6692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:30.124807 6692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6692
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:30.125808 6692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:30.127095 6692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:30.136435 6700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:30.136484 6692 server_base.cc:1034] running on GCE node
W20260811 04:52:30.136435 6698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:30.136508 6697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:30.137041 6692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:30.137643 6692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:30.138834 6692 hybrid_clock.cc:648] HybridClock initialized: now 1786423950138821 us; error 35 us; skew 500 ppm
I20260811 04:52:30.140501 6692 webserver.cc:460] Webserver started at http://127.17.188.66:40519/ using document root <none> and password file <none>
I20260811 04:52:30.141048 6692 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:30.141137 6692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:30.141362 6692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:30.143409 6692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "7462d48394b549b48d82482daab6e5a4"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "23f0363c070b30f3b83e69acfa8f519b"
server_key_iv: "fafde9f207b52e7eeac657ce5b4edda6"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.143963 6692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "7462d48394b549b48d82482daab6e5a4"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "23f0363c070b30f3b83e69acfa8f519b"
server_key_iv: "fafde9f207b52e7eeac657ce5b4edda6"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.147397 6692 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:30.149955 6708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.151141 6692 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:30.151269 6692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "7462d48394b549b48d82482daab6e5a4"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "23f0363c070b30f3b83e69acfa8f519b"
server_key_iv: "fafde9f207b52e7eeac657ce5b4edda6"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.151379 6692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:30.169093 6692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:30.169831 6692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:30.170013 6692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:30.170562 6692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:30.171445 6692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:30.171514 6692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.171587 6692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:30.171629 6692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.181711 6692 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:39555
I20260811 04:52:30.181738 6834 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:39555 every 8 connection(s)
I20260811 04:52:30.182603 6692 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:30.189486 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6692
I20260811 04:52:30.189641 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:30.189929 18161 external_mini_cluster.cc:1428] Setting key 09da1c162d211ad992144386d0a57bb1
I20260811 04:52:30.191917 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.184365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:45563 (local address 127.17.188.126:35883)
0811 04:52:30.184513 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.184517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.185549 (+ 1032us) server_negotiation.cc:407] Connection header received
0811 04:52:30.187033 (+ 1484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.187036 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.187112 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.187228 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:30.188111 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.188646 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.189925 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.190204 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.190316 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.191442 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:30.191445 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:30.191448 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:30.191467 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:30.191484 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:30.191492 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:30.191567 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.191723 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.191782 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:52:30.191959 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--builtin_ntp_servers=127.17.188.84:39409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:30.192879 6837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.184762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35883 (local address 127.17.188.66:45563)
0811 04:52:30.185402 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.185442 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.186808 (+ 1366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.187400 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.187407 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.187489 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:30.187965 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.187977 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.188784 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.188792 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.189802 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.189813 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.190359 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.190363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.190560 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.191188 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:30.191190 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:30.191237 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:30.191298 (+ 61us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:30.191568 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:30.191580 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:30.191587 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.191723 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.191995 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":115,"threads_started":1}
I20260811 04:52:30.194067 6835 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35883
I20260811 04:52:30.194298 6835 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:30.194828 6835 heartbeater.cc:511] Master 127.17.188.126:35883 requested a full tablet report, sending...
I20260811 04:52:30.195832 6479 ts_manager.cc:194] Registered new tserver with Master: 7462d48394b549b48d82482daab6e5a4 (127.17.188.66:39555)
I20260811 04:52:30.196393 6479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.66:45563
W20260811 04:52:30.306844 6838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:30.307261 6838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:30.307310 6838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:30.311533 6838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:30.311609 6838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:30.311698 6838 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:30.316476 6838 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:39409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35883
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:30.317553 6838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:30.319029 6838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:30.328590 6845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:30.328599 6843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:30.328855 6838 server_base.cc:1034] running on GCE node
W20260811 04:52:30.328599 6849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:30.329413 6838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:30.330101 6838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:30.331311 6838 hybrid_clock.cc:648] HybridClock initialized: now 1786423950331279 us; error 43 us; skew 500 ppm
I20260811 04:52:30.333348 6838 webserver.cc:460] Webserver started at http://127.17.188.67:41405/ using document root <none> and password file <none>
I20260811 04:52:30.333961 6838 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:30.334024 6838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:30.334192 6838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:30.336236 6838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "391b2dbc012c4ef99e74b5d52e77dcee"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "d7aeb58ff2aba841c725b9ac4c43b033"
server_key_iv: "ce65f5f22a6b4290d52d0f05f16df05a"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.336747 6838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "391b2dbc012c4ef99e74b5d52e77dcee"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "d7aeb58ff2aba841c725b9ac4c43b033"
server_key_iv: "ce65f5f22a6b4290d52d0f05f16df05a"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.340317 6838 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:52:30.342674 6856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.343858 6838 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:30.343950 6838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "391b2dbc012c4ef99e74b5d52e77dcee"
format_stamp: "Formatted at 2026-08-11 04:52:30 on dist-test-slave-njxd"
server_key: "d7aeb58ff2aba841c725b9ac4c43b033"
server_key_iv: "ce65f5f22a6b4290d52d0f05f16df05a"
server_key_version: "encryptionkey@0"
I20260811 04:52:30.344033 6838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:30.352962 6838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:30.353550 6838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:30.353787 6838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:30.354307 6838 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:30.355288 6838 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:30.355338 6838 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.355377 6838 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:30.355398 6838 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:30.364814 6838 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:46781
I20260811 04:52:30.364840 6984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:46781 every 8 connection(s)
I20260811 04:52:30.365844 6838 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:30.369333 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 6838
I20260811 04:52:30.369452 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:30.369766 18161 external_mini_cluster.cc:1428] Setting key fd849fa5d881826bed0f938666699a19
I20260811 04:52:30.375619 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.367693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:36731 (local address 127.17.188.126:35883)
0811 04:52:30.367840 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.367843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.369006 (+ 1163us) server_negotiation.cc:407] Connection header received
0811 04:52:30.370863 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.370866 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.370921 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.371024 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:30.372230 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.372752 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.373917 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.374132 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.374215 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.375226 (+ 1011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:30.375229 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:30.375231 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:30.375243 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:30.375262 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:30.375270 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:30.375322 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.375457 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.375508 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:52:30.376597 6987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.368069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35883 (local address 127.17.188.67:36731)
0811 04:52:30.368842 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.368883 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.370601 (+ 1718us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.371246 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.371253 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.371376 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:30.372078 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.372111 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.372857 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.372859 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.373814 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.373823 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.374262 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.374265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.374410 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.374976 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:30.374978 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:30.375017 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:30.375081 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:30.375336 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:30.375343 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:30.375346 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.375441 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.375660 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":118,"threads_started":1}
I20260811 04:52:30.377826 6985 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35883
I20260811 04:52:30.378106 6985 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:30.378614 6985 heartbeater.cc:511] Master 127.17.188.126:35883 requested a full tablet report, sending...
I20260811 04:52:30.379606 6479 ts_manager.cc:194] Registered new tserver with Master: 391b2dbc012c4ef99e74b5d52e77dcee (127.17.188.67:46781)
I20260811 04:52:30.380185 6479 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.67:36731
I20260811 04:52:30.383724 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:30.389369 6520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.385768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38354 (local address 127.17.188.126:35883)
0811 04:52:30.385915 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.385919 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.386094 (+ 175us) server_negotiation.cc:407] Connection header received
0811 04:52:30.386210 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.386212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.386250 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.386312 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:30.386510 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.387002 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.387819 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.388021 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.388093 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.388861 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:30.388864 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:30.388866 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:30.388877 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:30.388895 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:30.388903 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:30.389008 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.389132 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.389198 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:52:30.392400 6479 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:30.395511 6479 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:30.409722 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.404732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.17.188.67:46781)
0811 04:52:30.405088 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.405100 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.405667 (+ 567us) server_negotiation.cc:407] Connection header received
0811 04:52:30.405752 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.405757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.405940 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.406087 (+ 147us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:30.406317 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.407230 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.408484 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409007 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409136 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409334 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.409427 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.409520 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":181,"threads_started":1}
I20260811 04:52:30.409715 7003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.404378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:46781 (local address 127.0.0.1:33810)
0811 04:52:30.405432 (+ 1054us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.405446 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.405536 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.406090 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.406093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.406112 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:30.406194 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.406200 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.407337 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.407342 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.408335 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.408344 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409134 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.409240 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409276 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.409397 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.409521 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":9,"thread_start_us":96,"threads_started":1}
I20260811 04:52:30.410040 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.403676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:34435 (local address 127.0.0.1:45298)
0811 04:52:30.404403 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.404454 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.404585 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.405334 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.405337 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.405356 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:30.405472 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.405482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.406910 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.406913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.408094 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.408099 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409401 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.409654 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409735 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.409809 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.409910 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"mutex_wait_us":165,"thread_start_us":79,"threads_started":1}
I20260811 04:52:30.410183 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.404111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39384 (local address 127.17.188.66:39555)
0811 04:52:30.404831 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.404842 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.404862 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:52:30.404928 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.404932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.405081 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.405215 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:30.405546 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.406524 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.408236 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409038 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409153 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409332 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.409910 (+ 578us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.410003 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":137,"threads_started":1}
I20260811 04:52:30.410494 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.403904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:39555 (local address 127.0.0.1:39384)
0811 04:52:30.404693 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.404707 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.404792 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.405233 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.405239 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.405267 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:30.405410 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.405419 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.406626 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.406631 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.408087 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.408098 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409401 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.409693 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409745 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.409809 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.410381 (+ 572us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":712,"mutex_wait_us":656,"thread_start_us":105,"threads_started":1}
I20260811 04:52:30.410609 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.403817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45298 (local address 127.17.188.65:34435)
0811 04:52:30.404579 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.404592 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.404619 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:52:30.404791 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.404798 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.405003 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.405167 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:30.405639 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.406793 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.408236 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.409038 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.409144 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.409332 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.410335 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.410431 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":157,"threads_started":1}
I20260811 04:52:30.413005 6908 tablet_service.cc:1467] Processing CreateTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 (DEFAULT_TABLE table=test-table [id=257333edc4bb49078584a7b3fcbf8291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:30.414033 6908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c97554418aa4a9b95eb0488f11454c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:30.413604 6761 tablet_service.cc:1467] Processing CreateTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 (DEFAULT_TABLE table=test-table [id=257333edc4bb49078584a7b3fcbf8291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:30.413606 6614 tablet_service.cc:1467] Processing CreateTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 (DEFAULT_TABLE table=test-table [id=257333edc4bb49078584a7b3fcbf8291]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:30.414675 6614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c97554418aa4a9b95eb0488f11454c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:30.414673 6761 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c97554418aa4a9b95eb0488f11454c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:30.420965 7005 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Bootstrap starting.
I20260811 04:52:30.421826 7007 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Bootstrap starting.
I20260811 04:52:30.422660 7008 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Bootstrap starting.
I20260811 04:52:30.423514 7005 tablet_bootstrap.cc:654] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:30.424122 7007 tablet_bootstrap.cc:654] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:30.424386 7008 tablet_bootstrap.cc:654] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:30.424418 7005 log.cc:824] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:30.424945 7007 log.cc:824] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:30.425165 7008 log.cc:824] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:30.426899 7005 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: No bootstrap required, opened a new log
I20260811 04:52:30.427079 7008 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: No bootstrap required, opened a new log
I20260811 04:52:30.427094 7005 ts_tablet_manager.cc:1397] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:30.427098 7007 tablet_bootstrap.cc:492] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: No bootstrap required, opened a new log
I20260811 04:52:30.427251 7008 ts_tablet_manager.cc:1397] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 04:52:30.427325 7007 ts_tablet_manager.cc:1397] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260811 04:52:30.430444 7007 raft_consensus.cc:348] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.430681 7007 raft_consensus.cc:374] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:30.430735 7007 raft_consensus.cc:729] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bda3b1181b914b53a7c858a06512cf6f, State: Initialized, Role: FOLLOWER
I20260811 04:52:30.431226 7007 consensus_queue.cc:260] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.431419 7008 raft_consensus.cc:348] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.431419 7005 raft_consensus.cc:348] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.431679 7008 raft_consensus.cc:374] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:30.431679 7005 raft_consensus.cc:374] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:30.431738 7008 raft_consensus.cc:729] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7462d48394b549b48d82482daab6e5a4, State: Initialized, Role: FOLLOWER
I20260811 04:52:30.431747 7005 raft_consensus.cc:729] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391b2dbc012c4ef99e74b5d52e77dcee, State: Initialized, Role: FOLLOWER
I20260811 04:52:30.432186 7008 consensus_queue.cc:260] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.432186 7005 consensus_queue.cc:260] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.432258 7007 ts_tablet_manager.cc:1428] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260811 04:52:30.432288 6688 heartbeater.cc:503] Master 127.17.188.126:35883 was elected leader, sending a full tablet report...
I20260811 04:52:30.433115 7008 ts_tablet_manager.cc:1428] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 04:52:30.433115 7005 ts_tablet_manager.cc:1428] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 04:52:30.433437 6835 heartbeater.cc:503] Master 127.17.188.126:35883 was elected leader, sending a full tablet report...
I20260811 04:52:30.433437 6985 heartbeater.cc:503] Master 127.17.188.126:35883 was elected leader, sending a full tablet report...
W20260811 04:52:30.433880 6836 tablet.cc:2369] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:52:30.495510 6689 tablet.cc:2369] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 04:52:30.616842 6986 tablet.cc:2369] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:30.708999 7012 raft_consensus.cc:482] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:30.709241 7012 raft_consensus.cc:504] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.710438 7012 leader_election.cc:288] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 391b2dbc012c4ef99e74b5d52e77dcee (127.17.188.67:46781), 7462d48394b549b48d82482daab6e5a4 (127.17.188.66:39555)
I20260811 04:52:30.714623 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.710975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:60861 (local address 127.17.188.67:46781)
0811 04:52:30.711094 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.711100 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.711266 (+ 166us) server_negotiation.cc:407] Connection header received
0811 04:52:30.711386 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.711389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.711432 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.711491 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:30.711838 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.712344 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.713550 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.713985 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.714081 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.714163 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.714355 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.714443 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:52:30.714671 7002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.710879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:51979 (local address 127.17.188.66:39555)
0811 04:52:30.711031 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.711036 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.711215 (+ 179us) server_negotiation.cc:407] Connection header received
0811 04:52:30.711383 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.711386 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.711439 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.711530 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:30.711838 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.712348 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.713551 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.714011 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.714163 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.714216 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.714444 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.714526 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 04:52:30.714659 7015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.710787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:46781 (local address 127.17.188.65:60861)
0811 04:52:30.711144 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.711155 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.711284 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.711532 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.711535 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.711551 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:30.711719 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.711726 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.712467 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.712471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.713411 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.713422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.714125 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.714129 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.714220 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.714246 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.714324 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.714409 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":23,"spinlock_wait_cycles":10624,"thread_start_us":67,"threads_started":1}
I20260811 04:52:30.714684 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.710757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:39555 (local address 127.17.188.65:51979)
0811 04:52:30.711089 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.711104 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:30.711257 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:30.711565 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:30.711568 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:30.711612 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:30.711724 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.711729 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.712471 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.712474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.713408 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:30.713419 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.714185 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.714191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:30.714285 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.714333 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 04:52:30.714409 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 04:52:30.714474 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":30,"spinlock_wait_cycles":3200,"thread_start_us":82,"threads_started":1}
I20260811 04:52:30.715538 6784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c97554418aa4a9b95eb0488f11454c4" candidate_uuid: "bda3b1181b914b53a7c858a06512cf6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7462d48394b549b48d82482daab6e5a4" is_pre_election: true
I20260811 04:52:30.715559 6932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c97554418aa4a9b95eb0488f11454c4" candidate_uuid: "bda3b1181b914b53a7c858a06512cf6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" is_pre_election: true
I20260811 04:52:30.715868 6784 raft_consensus.cc:2454] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda3b1181b914b53a7c858a06512cf6f in term 0.
I20260811 04:52:30.715883 6932 raft_consensus.cc:2454] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bda3b1181b914b53a7c858a06512cf6f in term 0.
I20260811 04:52:30.716395 6565 leader_election.cc:302] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 391b2dbc012c4ef99e74b5d52e77dcee, 7462d48394b549b48d82482daab6e5a4, bda3b1181b914b53a7c858a06512cf6f; no voters:
I20260811 04:52:30.716728 7012 raft_consensus.cc:2781] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:30.716809 7012 raft_consensus.cc:482] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:30.716840 7012 raft_consensus.cc:3037] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:30.717967 7012 raft_consensus.cc:504] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.718364 7012 leader_election.cc:288] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [CANDIDATE]: Term 1 election: Requested vote from peers 391b2dbc012c4ef99e74b5d52e77dcee (127.17.188.67:46781), 7462d48394b549b48d82482daab6e5a4 (127.17.188.66:39555)
I20260811 04:52:30.718783 6932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c97554418aa4a9b95eb0488f11454c4" candidate_uuid: "bda3b1181b914b53a7c858a06512cf6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391b2dbc012c4ef99e74b5d52e77dcee"
I20260811 04:52:30.718775 6784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c97554418aa4a9b95eb0488f11454c4" candidate_uuid: "bda3b1181b914b53a7c858a06512cf6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7462d48394b549b48d82482daab6e5a4"
I20260811 04:52:30.718909 6784 raft_consensus.cc:3037] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:30.718909 6932 raft_consensus.cc:3037] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:30.720281 6784 raft_consensus.cc:2454] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda3b1181b914b53a7c858a06512cf6f in term 1.
I20260811 04:52:30.720283 6932 raft_consensus.cc:2454] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bda3b1181b914b53a7c858a06512cf6f in term 1.
I20260811 04:52:30.720629 6562 leader_election.cc:302] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7462d48394b549b48d82482daab6e5a4, bda3b1181b914b53a7c858a06512cf6f; no voters:
I20260811 04:52:30.720876 7012 raft_consensus.cc:2781] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:30.721112 7012 raft_consensus.cc:686] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [term 1 LEADER]: Becoming Leader. State: Replica: bda3b1181b914b53a7c858a06512cf6f, State: Running, Role: LEADER
I20260811 04:52:30.721449 7012 consensus_queue.cc:237] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } }
I20260811 04:52:30.725126 6479 catalog_manager.cc:5495] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f reported cstate change: term changed from 0 to 1, leader changed from <none> to bda3b1181b914b53a7c858a06512cf6f (127.17.188.65). New cstate: current_term: 1 leader_uuid: "bda3b1181b914b53a7c858a06512cf6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bda3b1181b914b53a7c858a06512cf6f" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 34435 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 } health_report { overall_health: UNKNOWN } } }
I20260811 04:52:30.773913 7000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.770117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45304 (local address 127.17.188.65:34435)
0811 04:52:30.770256 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:30.770260 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:30.770277 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:52:30.770355 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:30.770357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:30.770416 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:30.770510 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:30.770778 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.771288 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.772324 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:30.772555 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:30.772643 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:30.773023 (+ 380us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:30.773461 (+ 438us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:30.773631 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:30.773751 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 04:52:30.773789 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:52:30.780467 6784 raft_consensus.cc:1261] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 1 FOLLOWER]: Refusing update from remote peer bda3b1181b914b53a7c858a06512cf6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:30.781242 6932 raft_consensus.cc:1261] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 1 FOLLOWER]: Refusing update from remote peer bda3b1181b914b53a7c858a06512cf6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:30.781270 7017 consensus_queue.cc:1035] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7462d48394b549b48d82482daab6e5a4" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 39555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:30.781884 7012 consensus_queue.cc:1035] T 9c97554418aa4a9b95eb0488f11454c4 P bda3b1181b914b53a7c858a06512cf6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "391b2dbc012c4ef99e74b5d52e77dcee" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 46781 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:30.790844 7021 mvcc.cc:205] Tried to move back new op lower bound from 7317192502388801536 to 7317192502158094336. Current Snapshot: MvccSnapshot[applied={T|T < 7317192502388801536}]
I20260811 04:52:30.799716 6479 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:30.799918 6479 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:30.802616 6479 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f4f1a4d3eab47eb8d04d5f4869770c5: Sending DeleteTablet for 3 replicas of tablet 9c97554418aa4a9b95eb0488f11454c4
I20260811 04:52:30.803730 6761 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:30 UTC) from {username='slave'} at 127.0.0.1:39384
I20260811 04:52:30.803773 6908 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:30 UTC) from {username='slave'} at 127.0.0.1:33810
I20260811 04:52:30.804314 7032 tablet_replica.cc:330] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: stopping tablet replica
I20260811 04:52:30.804332 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6545
I20260811 04:52:30.804319 6614 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c97554418aa4a9b95eb0488f11454c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:30 UTC) from {username='slave'} at 127.0.0.1:45298
I20260811 04:52:30.804687 7032 raft_consensus.cc:2229] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:30.805097 7032 raft_consensus.cc:2258] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:30.805111 7031 tablet_replica.cc:330] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: stopping tablet replica
I20260811 04:52:30.805399 7031 raft_consensus.cc:2229] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:30.805723 7031 raft_consensus.cc:2258] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:30.806906 7032 ts_tablet_manager.cc:1905] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:30.810000 7032 ts_tablet_manager.cc:1918] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:30.810117 7032 log.cc:1196] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9c97554418aa4a9b95eb0488f11454c4
I20260811 04:52:30.810477 7032 ts_tablet_manager.cc:1939] T 9c97554418aa4a9b95eb0488f11454c4 P 391b2dbc012c4ef99e74b5d52e77dcee: Deleting consensus metadata
I20260811 04:52:30.810470 7031 ts_tablet_manager.cc:1905] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:30.811926 6464 catalog_manager.cc:4841] TS 391b2dbc012c4ef99e74b5d52e77dcee (127.17.188.67:46781): tablet 9c97554418aa4a9b95eb0488f11454c4 (table test-table [id=257333edc4bb49078584a7b3fcbf8291]) successfully deleted
I20260811 04:52:30.812762 7031 ts_tablet_manager.cc:1918] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:30.812875 7031 log.cc:1196] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9c97554418aa4a9b95eb0488f11454c4
I20260811 04:52:30.813182 7031 ts_tablet_manager.cc:1939] T 9c97554418aa4a9b95eb0488f11454c4 P 7462d48394b549b48d82482daab6e5a4: Deleting consensus metadata
I20260811 04:52:30.814371 6461 catalog_manager.cc:4841] TS 7462d48394b549b48d82482daab6e5a4 (127.17.188.66:39555): tablet 9c97554418aa4a9b95eb0488f11454c4 (table test-table [id=257333edc4bb49078584a7b3fcbf8291]) successfully deleted
W20260811 04:52:30.815526 6464 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:34435 (error 108)
I20260811 04:52:30.816443 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6692
I20260811 04:52:30.816695 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:30.816334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:34435 (local address 127.0.0.1:45314)
0811 04:52:30.816499 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:30.816588 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:34435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 04:52:30.818564 6464 catalog_manager.cc:4584] TS bda3b1181b914b53a7c858a06512cf6f (127.17.188.65:34435): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c97554418aa4a9b95eb0488f11454c4: Network error: Client connection negotiation failed: client connection to 127.17.188.65:34435: connect: Connection refused (error 111)
I20260811 04:52:30.824676 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6838
I20260811 04:52:30.836391 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 6443
2026-08-11T04:52:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1287 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:30 dist-test-slave-njxd krb5kdc[7037](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:30 dist-test-slave-njxd krb5kdc[7037](info): set up 2 sockets
Aug 11 04:52:30 dist-test-slave-njxd krb5kdc[7037](info): commencing operation
krb5kdc: starting...
W20260811 04:52:31.924790 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:32.052474 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44031
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:44031
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:32.165050 7053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:32.165380 7053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:32.165457 7053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:32.169462 7053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:32.169559 7053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:32.169590 7053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:32.169646 7053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:32.169694 7053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:32.174991 7053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:44031
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44031
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:32.176123 7053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:32.177204 7053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:32.186568 7059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.186795 7053 server_base.cc:1034] running on GCE node
W20260811 04:52:32.186568 7062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:32.186573 7060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.187580 7053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:32.188730 7053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:32.189896 7053 hybrid_clock.cc:648] HybridClock initialized: now 1786423952189877 us; error 32 us; skew 500 ppm
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:32.192821 7053 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:32.193758 7053 webserver.cc:460] Webserver started at http://127.17.188.126:43707/ using document root <none> and password file <none>
I20260811 04:52:32.194304 7053 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:32.194365 7053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:32.194538 7053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:32.196601 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "fcd4aa54a4774a1eb1ab3f92bd189908"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "303221c259db47cfcf574009d919240d"
server_key_iv: "c51794146cd3fad2224c8c4c3c68427c"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.197129 7053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "fcd4aa54a4774a1eb1ab3f92bd189908"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "303221c259db47cfcf574009d919240d"
server_key_iv: "c51794146cd3fad2224c8c4c3c68427c"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.200805 7053 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:52:32.203243 7071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.204504 7053 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:32.204614 7053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "fcd4aa54a4774a1eb1ab3f92bd189908"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "303221c259db47cfcf574009d919240d"
server_key_iv: "c51794146cd3fad2224c8c4c3c68427c"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.204799 7053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:32.219871 7053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:32.222970 7053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:32.223193 7053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:32.230548 7053 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:44031
I20260811 04:52:32.230621 7127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:44031 every 8 connection(s)
I20260811 04:52:32.231572 7053 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:32.234486 7128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:32.240131 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7053
I20260811 04:52:32.240127 7128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: Bootstrap starting.
I20260811 04:52:32.240304 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:32.240607 18161 external_mini_cluster.cc:1428] Setting key 1a180be873f16de5e57d6a23f3330e27
I20260811 04:52:32.242995 7128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:32.243897 7128 log.cc:824] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:32.246237 7128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: No bootstrap required, opened a new log
I20260811 04:52:32.250325 7128 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } }
I20260811 04:52:32.250607 7128 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:32.250676 7128 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcd4aa54a4774a1eb1ab3f92bd189908, State: Initialized, Role: FOLLOWER
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:32.251114 7128 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } }
I20260811 04:52:32.251272 7128 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:32.251366 7128 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:32.251483 7128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:32.252416 7128 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } }
I20260811 04:52:32.252767 7128 leader_election.cc:302] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcd4aa54a4774a1eb1ab3f92bd189908; no voters:
I20260811 04:52:32.253126 7128 leader_election.cc:288] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:32.253213 7135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:32.253391 7135 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [term 1 LEADER]: Becoming Leader. State: Replica: fcd4aa54a4774a1eb1ab3f92bd189908, State: Running, Role: LEADER
I20260811 04:52:32.253759 7135 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } }
I20260811 04:52:32.254611 7128 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:32.255434 7137 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcd4aa54a4774a1eb1ab3f92bd189908. Latest consensus state: current_term: 1 leader_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } } }
I20260811 04:52:32.256022 7137 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:32.255762 7136 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcd4aa54a4774a1eb1ab3f92bd189908" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44031 } } }
I20260811 04:52:32.256413 7136 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:32.256819 7146 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:32.257658 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.242042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48864 (local address 127.17.188.126:44031)
0811 04:52:32.242585 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:32.242605 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:32.242648 (+ 43us) server_negotiation.cc:407] Connection header received
0811 04:52:32.243552 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:32.243577 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:32.244016 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:32.244411 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:32.245255 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.246754 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.247647 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.248367 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.248525 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.251349 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:32.251358 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:32.251376 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:32.251409 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:32.253639 (+ 2230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.254159 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.254171 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.254175 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.254284 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.254616 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.254619 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.254620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.255203 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:32.256083 (+ 880us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:32.256292 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 04:52:32.256640 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":211,"threads_started":1}
I20260811 04:52:32.261039 7146 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:32.266958 7146 catalog_manager.cc:1347] Generated new cluster ID: 2bd95b8c343244f99e9ad4ef309ee58d
I20260811 04:52:32.267042 7146 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:32.293614 7146 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:32.294703 7146 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:32.302261 7146 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: Generated new TSK 0
I20260811 04:52:32.303007 7146 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.17.188.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
Entry for principal kudu/127.17.188.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab.
I20260811 04:52:32.338917 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:32.478869 7157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:32.479152 7157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:32.479197 7157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:32.483263 7157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:32.483325 7157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:32.483414 7157 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:32.488816 7157 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.65.keytab
--principal=kudu/127.17.188.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:32.490028 7157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:32.491123 7157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:32.501231 7164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.501432 7157 server_base.cc:1034] running on GCE node
W20260811 04:52:32.501231 7168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:32.501292 7162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.501950 7157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:32.502673 7157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:32.503862 7157 hybrid_clock.cc:648] HybridClock initialized: now 1786423952503849 us; error 30 us; skew 500 ppm
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:32.506732 7157 init.cc:377] Logged in from keytab as kudu/127.17.188.65@KRBTEST.COM (short username kudu)
I20260811 04:52:32.507685 7157 webserver.cc:460] Webserver started at http://127.17.188.65:36933/ using document root <none> and password file <none>
I20260811 04:52:32.508352 7157 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:32.508495 7157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:32.508745 7157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:32.510949 7157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "e3dc879e71d2d47b5ea4e7328ee29af7"
server_key_iv: "3f60e45df8d0d12299185b8d708b44bb"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.511533 7157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "e3dc879e71d2d47b5ea4e7328ee29af7"
server_key_iv: "3f60e45df8d0d12299185b8d708b44bb"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.515309 7157 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 04:52:32.517846 7175 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.519073 7157 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:32.519215 7157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "e3dc879e71d2d47b5ea4e7328ee29af7"
server_key_iv: "3f60e45df8d0d12299185b8d708b44bb"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.519331 7157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:32.534073 7157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:32.536897 7157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:32.537109 7157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:32.537750 7157 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:32.538594 7157 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:32.538666 7157 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.538736 7157 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:32.538790 7157 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.547693 7157 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:43495
I20260811 04:52:32.547730 7296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:43495 every 8 connection(s)
I20260811 04:52:32.548579 7157 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:32.557842 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7157
I20260811 04:52:32.558008 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:32.558377 18161 external_mini_cluster.cc:1428] Setting key c9f6adb45bf8fe51748ecd18a4c8b0dd
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.65@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:32.563470 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.550352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:33607 (local address 127.17.188.126:44031)
0811 04:52:32.550494 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:32.550498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:32.551305 (+ 807us) server_negotiation.cc:407] Connection header received
0811 04:52:32.552696 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:32.552699 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:32.552761 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:32.552869 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:32.554097 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.554737 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.556124 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.556369 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.556481 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.559324 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:32.559328 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:32.559331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:32.559356 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:32.561082 (+ 1726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.561700 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.561707 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.561711 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.561813 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.562207 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.562213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.562218 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.562495 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:32.562607 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:32.563245 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 04:52:32.563349 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:52:32.564530 7299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.550711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44031 (local address 127.17.188.65:33607)
0811 04:52:32.551159 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:32.551204 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:32.552471 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:32.553048 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:32.553055 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:32.553409 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:32.553947 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.553961 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.554877 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.554880 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.555997 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.556007 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.556537 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.556542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.556708 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.557357 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:32.557374 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:32.559171 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:32.561212 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.561221 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.561238 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.561604 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.561916 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.561922 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.561926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.562099 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.562621 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:32.562629 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:32.562962 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 04:52:32.563187 (+ 225us) client_negotiation.cc:240] Negotiation successful
0811 04:52:32.563567 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":115,"threads_started":1}
I20260811 04:52:32.565838 7297 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44031
I20260811 04:52:32.566089 7297 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:32.566582 7297 heartbeater.cc:511] Master 127.17.188.126:44031 requested a full tablet report, sending...
I20260811 04:52:32.568069 7090 ts_manager.cc:194] Registered new tserver with Master: 7b7c63a7520143838bdbdf2d6d9c9ad2 (127.17.188.65:43495)
I20260811 04:52:32.569196 7090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.65@KRBTEST.COM'} at 127.17.188.65:33607
WARNING: no policy specified for kudu/127.17.188.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
Entry for principal kudu/127.17.188.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab.
I20260811 04:52:32.589227 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:32.702103 7304 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:32.702360 7304 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:32.702462 7304 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:32.706459 7304 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:32.706509 7304 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:32.706599 7304 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:32.712049 7304 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.66.keytab
--principal=kudu/127.17.188.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7304
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:32.713109 7304 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:32.714207 7304 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:52:32.724052 7304 server_base.cc:1034] running on GCE node
W20260811 04:52:32.724148 7309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:32.724184 7312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:32.724148 7310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.724788 7304 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:32.725450 7304 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:32.726639 7304 hybrid_clock.cc:648] HybridClock initialized: now 1786423952726605 us; error 44 us; skew 500 ppm
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:32.729435 7304 init.cc:377] Logged in from keytab as kudu/127.17.188.66@KRBTEST.COM (short username kudu)
I20260811 04:52:32.730484 7304 webserver.cc:460] Webserver started at http://127.17.188.66:33781/ using document root <none> and password file <none>
I20260811 04:52:32.731098 7304 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:32.731200 7304 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:32.731449 7304 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:32.733539 7304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "100bf04226fe4d239894eb8560abe8f7"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "80674373d46fd3303636ec66fa70ec0c"
server_key_iv: "eababfde290f0827453a8dd6334dc46f"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.734184 7304 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "100bf04226fe4d239894eb8560abe8f7"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "80674373d46fd3303636ec66fa70ec0c"
server_key_iv: "eababfde290f0827453a8dd6334dc46f"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.738034 7304 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:52:32.740401 7321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.741616 7304 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:32.741762 7304 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "100bf04226fe4d239894eb8560abe8f7"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "80674373d46fd3303636ec66fa70ec0c"
server_key_iv: "eababfde290f0827453a8dd6334dc46f"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.741868 7304 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:32.753137 7304 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:32.756470 7304 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:32.756711 7304 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:32.757310 7304 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:32.758210 7304 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:32.758279 7304 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.758342 7304 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:32.758391 7304 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.767124 7304 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:44497
I20260811 04:52:32.767153 7444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:44497 every 8 connection(s)
I20260811 04:52:32.768021 7304 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:32.776834 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7304
I20260811 04:52:32.776974 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:32.777243 18161 external_mini_cluster.cc:1428] Setting key aa4d6959fe45f91a1c1cc64cd05ac626
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.66@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:32.781677 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.769775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:55255 (local address 127.17.188.126:44031)
0811 04:52:32.769944 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:32.769948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:32.770824 (+ 876us) server_negotiation.cc:407] Connection header received
0811 04:52:32.772204 (+ 1380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:32.772208 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:32.772267 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:32.772373 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:32.773534 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.774162 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.775315 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.775539 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.775653 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.778075 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:32.778079 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:32.778081 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:32.778105 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:32.779584 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.780130 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.780133 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.780134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.780216 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.780575 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.780579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.780581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.780759 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:32.780870 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:32.781363 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 04:52:32.781477 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 04:52:32.782469 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.770216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44031 (local address 127.17.188.66:55255)
0811 04:52:32.770669 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:32.770711 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:32.771990 (+ 1279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:32.772565 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:32.772572 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:32.772920 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:32.773384 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.773397 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.774291 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.774295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.775183 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.775193 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.775703 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.775707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.775886 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.776418 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:32.776434 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:32.777909 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:32.779710 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.779716 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.779730 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.779991 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.780309 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.780312 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.780314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.780473 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.780870 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:32.780878 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:32.781117 (+ 239us) client_negotiation.cc:769] Sending connection context
0811 04:52:32.781320 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 04:52:32.781661 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":110,"threads_started":1}
I20260811 04:52:32.783682 7445 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44031
I20260811 04:52:32.783933 7445 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:32.784415 7445 heartbeater.cc:511] Master 127.17.188.126:44031 requested a full tablet report, sending...
I20260811 04:52:32.785475 7090 ts_manager.cc:194] Registered new tserver with Master: 100bf04226fe4d239894eb8560abe8f7 (127.17.188.66:44497)
I20260811 04:52:32.786070 7090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.66@KRBTEST.COM'} at 127.17.188.66:55255
WARNING: no policy specified for kudu/127.17.188.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
Entry for principal kudu/127.17.188.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab.
I20260811 04:52:32.804874 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:32.915552 7450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:32.915808 7450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:32.915848 7450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:32.919668 7450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:32.919716 7450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:32.919788 7450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:32.925145 7450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.67.keytab
--principal=kudu/127.17.188.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:44031
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:32.926187 7450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:32.927143 7450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:32.936470 7455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.936491 7450 server_base.cc:1034] running on GCE node
W20260811 04:52:32.936508 7456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:32.936509 7458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:32.937110 7450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:32.937769 7450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:32.938963 7450 hybrid_clock.cc:648] HybridClock initialized: now 1786423952938927 us; error 48 us; skew 500 ppm
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:32.941535 7450 init.cc:377] Logged in from keytab as kudu/127.17.188.67@KRBTEST.COM (short username kudu)
I20260811 04:52:32.942348 7450 webserver.cc:460] Webserver started at http://127.17.188.67:42435/ using document root <none> and password file <none>
I20260811 04:52:32.942854 7450 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:32.942912 7450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:32.943071 7450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:32.945230 7450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "0a1dbc7ef0384451b813e52a130acf6f"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "c8ea6afca17f8468d0ea9b86d8316f0b"
server_key_iv: "7ce9caf4160a1ccaa8dd28a662a0a000"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.945930 7450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "0a1dbc7ef0384451b813e52a130acf6f"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "c8ea6afca17f8468d0ea9b86d8316f0b"
server_key_iv: "7ce9caf4160a1ccaa8dd28a662a0a000"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.949682 7450 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:52:32.952113 7465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.953351 7450 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:32.953483 7450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "0a1dbc7ef0384451b813e52a130acf6f"
format_stamp: "Formatted at 2026-08-11 04:52:32 on dist-test-slave-njxd"
server_key: "c8ea6afca17f8468d0ea9b86d8316f0b"
server_key_iv: "7ce9caf4160a1ccaa8dd28a662a0a000"
server_key_version: "encryptionkey@0"
I20260811 04:52:32.953706 7450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:32.964301 7450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:32.967104 7450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:32.967326 7450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:32.967921 7450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:32.968796 7450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:32.968847 7450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.968927 7450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:32.968966 7450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:32.978499 7450 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:38947
I20260811 04:52:32.978523 7589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:38947 every 8 connection(s)
I20260811 04:52:32.979401 7450 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:32.981895 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7450
I20260811 04:52:32.982060 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:32.982388 18161 external_mini_cluster.cc:1428] Setting key e2c040d68b55ae42fac0b1acf21b4521
Aug 11 04:52:32 dist-test-slave-njxd krb5kdc[7037](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423952, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.67@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:32.992888 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.981115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:47503 (local address 127.17.188.126:44031)
0811 04:52:32.981263 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:32.981267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:32.982200 (+ 933us) server_negotiation.cc:407] Connection header received
0811 04:52:32.983750 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:32.983754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:32.983812 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:32.983921 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:32.985088 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.985711 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.986852 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.987076 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.987189 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.989525 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:32.989528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:32.989531 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:32.989565 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:32.990843 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.991354 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.991359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.991361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.991451 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:32.991793 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:32.991797 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:32.991799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:32.991985 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:32.992101 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:32.992588 (+ 487us) server_negotiation.cc:299] Negotiation successful
0811 04:52:32.992717 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 04:52:32.993741 7592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:32.981428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:44031 (local address 127.17.188.67:47503)
0811 04:52:32.982004 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:32.982071 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:32.983540 (+ 1469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:32.984096 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:32.984103 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:32.984465 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:32.984943 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.984956 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.985851 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.985854 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.986721 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:32.986730 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:32.987236 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:32.987240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:32.987403 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:32.987932 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:52:32.987948 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:32.989365 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:32.990962 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.990968 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.990982 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.991246 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.991549 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:52:32.991553 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:52:32.991555 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:52:32.991696 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:52:32.992100 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:32.992107 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:32.992352 (+ 245us) client_negotiation.cc:769] Sending connection context
0811 04:52:32.992545 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 04:52:32.992857 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":200,"threads_started":1}
I20260811 04:52:32.994907 7590 heartbeater.cc:347] Connected to a master server at 127.17.188.126:44031
I20260811 04:52:32.995177 7590 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:32.995800 7590 heartbeater.cc:511] Master 127.17.188.126:44031 requested a full tablet report, sending...
I20260811 04:52:32.996873 7090 ts_manager.cc:194] Registered new tserver with Master: 0a1dbc7ef0384451b813e52a130acf6f (127.17.188.67:38947)
I20260811 04:52:32.997444 7090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.17.188.67@KRBTEST.COM'} at 127.17.188.67:47503
I20260811 04:52:33.007884 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:33.017131 7133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.010044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48876 (local address 127.17.188.126:44031)
0811 04:52:33.010203 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.010209 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.010369 (+ 160us) server_negotiation.cc:407] Connection header received
0811 04:52:33.010463 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.010465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.010503 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.010570 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:33.011215 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.011717 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.012571 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.012784 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.012857 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.014137 (+ 1280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:33.014141 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:33.014143 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:33.014164 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:33.015662 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:33.016030 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:33.016032 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:33.016033 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:33.016107 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:33.016334 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:33.016336 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:33.016337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:33.016537 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:33.016650 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.016821 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.016916 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 04:52:33.019989 7090 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48876:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:33.023131 7090 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:33.037720 7601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.031754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44497 (local address 127.0.0.1:59958)
0811 04:52:33.032553 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.032606 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.032757 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.033559 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.033562 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.033617 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:33.033787 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.033795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.035371 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.035374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.036208 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.036219 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.037065 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.037069 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.037203 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.037249 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.037390 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.037547 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":72,"spinlock_wait_cycles":2816,"thread_start_us":86,"threads_started":1}
I20260811 04:52:33.037726 7604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.031877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59958 (local address 127.17.188.66:44497)
0811 04:52:33.033060 (+ 1183us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.033073 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.033096 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:52:33.033191 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.033197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.033405 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.033929 (+ 524us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:33.034084 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.035223 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.036337 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.036935 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.037065 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.037221 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.037422 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.037532 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1068,"thread_start_us":127,"threads_started":1}
I20260811 04:52:33.037755 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.032103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:43495 (local address 127.0.0.1:38318)
0811 04:52:33.032994 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.033007 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.033085 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.033538 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.033544 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.033566 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:33.033797 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.033805 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.034866 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.034869 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.036052 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.036063 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.037232 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.037236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.037331 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.037356 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.037403 (+ 47us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.037558 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"mutex_wait_us":57,"thread_start_us":90,"threads_started":1}
I20260811 04:52:33.038733 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.032550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38318 (local address 127.17.188.65:43495)
0811 04:52:33.033039 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.033057 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.033084 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:52:33.033203 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.033208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.033381 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.033545 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:33.033931 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.034726 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.036200 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.037077 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.038276 (+ 1199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.038430 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.038484 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.038590 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":123,"threads_started":1}
I20260811 04:52:33.039302 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.031827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:38947 (local address 127.0.0.1:32796)
0811 04:52:33.032615 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.032631 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.032757 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.033797 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.033800 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.033817 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:33.033910 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.033917 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.035371 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.035375 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.037433 (+ 2058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.037441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.038600 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.038603 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.039006 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.039031 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.039105 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.039181 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"mutex_wait_us":33,"spinlock_wait_cycles":7296,"thread_start_us":108,"threads_started":1}
I20260811 04:52:33.039955 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.032550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32796 (local address 127.17.188.67:38947)
0811 04:52:33.033352 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.033362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.033383 (+ 21us) server_negotiation.cc:407] Connection header received
0811 04:52:33.033455 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.033463 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.033668 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.033819 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:33.034023 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.035210 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.037566 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.038471 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.038582 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.038723 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.039724 (+ 1001us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.039821 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":139,"threads_started":1}
I20260811 04:52:33.041129 7370 tablet_service.cc:1467] Processing CreateTablet for tablet 72811f0131cd407c858278577c531640 (DEFAULT_TABLE table=test-table [id=a170ac69047e496eaf5fca2efdcde620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:33.042135 7370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72811f0131cd407c858278577c531640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:33.042415 7519 tablet_service.cc:1467] Processing CreateTablet for tablet 72811f0131cd407c858278577c531640 (DEFAULT_TABLE table=test-table [id=a170ac69047e496eaf5fca2efdcde620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:33.043349 7519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72811f0131cd407c858278577c531640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:33.048506 7608 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Bootstrap starting.
I20260811 04:52:33.048593 7225 tablet_service.cc:1467] Processing CreateTablet for tablet 72811f0131cd407c858278577c531640 (DEFAULT_TABLE table=test-table [id=a170ac69047e496eaf5fca2efdcde620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:33.049558 7225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72811f0131cd407c858278577c531640. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:33.049850 7609 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Bootstrap starting.
I20260811 04:52:33.051079 7608 tablet_bootstrap.cc:654] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:33.051959 7609 tablet_bootstrap.cc:654] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:33.052556 7608 log.cc:824] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:33.053241 7609 log.cc:824] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:33.054838 7608 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: No bootstrap required, opened a new log
I20260811 04:52:33.055040 7608 ts_tablet_manager.cc:1397] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 04:52:33.055291 7609 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: No bootstrap required, opened a new log
I20260811 04:52:33.055475 7609 ts_tablet_manager.cc:1397] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260811 04:52:33.056371 7613 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: Bootstrap starting.
I20260811 04:52:33.059077 7613 tablet_bootstrap.cc:654] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:33.059489 7608 raft_consensus.cc:348] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.059489 7609 raft_consensus.cc:348] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.059767 7609 raft_consensus.cc:374] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:33.059767 7608 raft_consensus.cc:374] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:33.059828 7608 raft_consensus.cc:729] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 100bf04226fe4d239894eb8560abe8f7, State: Initialized, Role: FOLLOWER
I20260811 04:52:33.059828 7609 raft_consensus.cc:729] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a1dbc7ef0384451b813e52a130acf6f, State: Initialized, Role: FOLLOWER
I20260811 04:52:33.060326 7613 log.cc:824] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:33.060282 7609 consensus_queue.cc:260] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.060282 7608 consensus_queue.cc:260] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.061015 7590 heartbeater.cc:503] Master 127.17.188.126:44031 was elected leader, sending a full tablet report...
I20260811 04:52:33.061301 7609 ts_tablet_manager.cc:1428] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260811 04:52:33.061301 7608 ts_tablet_manager.cc:1428] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Time spent starting tablet: real 0.006s user 0.001s sys 0.005s
I20260811 04:52:33.061318 7445 heartbeater.cc:503] Master 127.17.188.126:44031 was elected leader, sending a full tablet report...
I20260811 04:52:33.063251 7613 tablet_bootstrap.cc:492] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: No bootstrap required, opened a new log
I20260811 04:52:33.063467 7613 ts_tablet_manager.cc:1397] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 04:52:33.066890 7613 raft_consensus.cc:348] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.067090 7613 raft_consensus.cc:374] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:33.067169 7613 raft_consensus.cc:729] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b7c63a7520143838bdbdf2d6d9c9ad2, State: Initialized, Role: FOLLOWER
I20260811 04:52:33.067610 7613 consensus_queue.cc:260] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.068187 7297 heartbeater.cc:503] Master 127.17.188.126:44031 was elected leader, sending a full tablet report...
I20260811 04:52:33.068511 7613 ts_tablet_manager.cc:1428] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:52:33.173372 7617 raft_consensus.cc:482] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:33.173612 7617 raft_consensus.cc:504] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.174780 7617 leader_election.cc:288] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 100bf04226fe4d239894eb8560abe8f7 (127.17.188.66:44497), 0a1dbc7ef0384451b813e52a130acf6f (127.17.188.67:38947)
I20260811 04:52:33.179018 7604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.175164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35949 (local address 127.17.188.66:44497)
0811 04:52:33.175310 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.175315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.175620 (+ 305us) server_negotiation.cc:407] Connection header received
0811 04:52:33.175835 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.175838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.175885 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.175971 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:33.176274 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.176774 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.177973 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.178381 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.178513 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.178570 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.178797 (+ 227us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.178878 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:52:33.179018 7607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.175153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:35985 (local address 127.17.188.67:38947)
0811 04:52:33.175310 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.175315 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.175617 (+ 302us) server_negotiation.cc:407] Connection header received
0811 04:52:33.175829 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.175839 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.175887 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.175981 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:33.176289 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.176771 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.177976 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.178386 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.178519 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.178575 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.178800 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.178876 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 04:52:33.179040 7618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.175075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:38947 (local address 127.17.188.65:35985)
0811 04:52:33.175490 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.175503 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.175706 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.175991 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.175995 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.176020 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:33.176167 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.176172 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.176894 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.176898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.177841 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.177850 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.178515 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.178518 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.178672 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.178690 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.178780 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.178872 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":91,"spinlock_wait_cycles":56704,"thread_start_us":143,"threads_started":1}
I20260811 04:52:33.179068 7621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.175075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:44497 (local address 127.17.188.65:35949)
0811 04:52:33.175501 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.175514 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.175707 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.175985 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.175988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.176006 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:33.176158 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.176165 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.176891 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.176895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.177848 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.177858 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.178513 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.178516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.178667 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.178686 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.178777 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.178880 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"mutex_wait_us":87,"spinlock_wait_cycles":25856,"thread_start_us":113,"threads_started":1}
I20260811 04:52:33.179733 7392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72811f0131cd407c858278577c531640" candidate_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100bf04226fe4d239894eb8560abe8f7" is_pre_election: true
I20260811 04:52:33.179989 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72811f0131cd407c858278577c531640" candidate_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a1dbc7ef0384451b813e52a130acf6f" is_pre_election: true
I20260811 04:52:33.180066 7392 raft_consensus.cc:2454] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b7c63a7520143838bdbdf2d6d9c9ad2 in term 0.
I20260811 04:52:33.180279 7541 raft_consensus.cc:2454] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b7c63a7520143838bdbdf2d6d9c9ad2 in term 0.
I20260811 04:52:33.180636 7179 leader_election.cc:302] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 100bf04226fe4d239894eb8560abe8f7, 7b7c63a7520143838bdbdf2d6d9c9ad2; no voters:
I20260811 04:52:33.180971 7617 raft_consensus.cc:2781] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:33.181071 7617 raft_consensus.cc:482] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:33.181133 7617 raft_consensus.cc:3037] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:33.182267 7617 raft_consensus.cc:504] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.182647 7617 leader_election.cc:288] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [CANDIDATE]: Term 1 election: Requested vote from peers 100bf04226fe4d239894eb8560abe8f7 (127.17.188.66:44497), 0a1dbc7ef0384451b813e52a130acf6f (127.17.188.67:38947)
I20260811 04:52:33.183068 7541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72811f0131cd407c858278577c531640" candidate_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a1dbc7ef0384451b813e52a130acf6f"
I20260811 04:52:33.183068 7392 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72811f0131cd407c858278577c531640" candidate_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "100bf04226fe4d239894eb8560abe8f7"
I20260811 04:52:33.183204 7541 raft_consensus.cc:3037] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:33.183204 7392 raft_consensus.cc:3037] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:33.184577 7392 raft_consensus.cc:2454] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b7c63a7520143838bdbdf2d6d9c9ad2 in term 1.
I20260811 04:52:33.184577 7541 raft_consensus.cc:2454] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b7c63a7520143838bdbdf2d6d9c9ad2 in term 1.
I20260811 04:52:33.184931 7177 leader_election.cc:302] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a1dbc7ef0384451b813e52a130acf6f, 7b7c63a7520143838bdbdf2d6d9c9ad2; no voters:
I20260811 04:52:33.185120 7617 raft_consensus.cc:2781] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:33.185377 7617 raft_consensus.cc:686] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 1 LEADER]: Becoming Leader. State: Replica: 7b7c63a7520143838bdbdf2d6d9c9ad2, State: Running, Role: LEADER
I20260811 04:52:33.185788 7617 consensus_queue.cc:237] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } }
I20260811 04:52:33.188978 7089 catalog_manager.cc:5495] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b7c63a7520143838bdbdf2d6d9c9ad2 (127.17.188.65). New cstate: current_term: 1 leader_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b7c63a7520143838bdbdf2d6d9c9ad2" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 43495 } health_report { overall_health: HEALTHY } } }
W20260811 04:52:33.230443 7591 tablet.cc:2369] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:33.231775 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.227756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.17.188.65:43495)
0811 04:52:33.227911 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.227915 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.227931 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:52:33.228114 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.228117 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.228178 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.228294 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:33.228579 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.229115 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.230011 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.230274 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.230382 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.230788 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:33.231266 (+ 478us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:33.231439 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.231560 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.231618 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 04:52:33.238207 7541 raft_consensus.cc:1261] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 1 FOLLOWER]: Refusing update from remote peer 7b7c63a7520143838bdbdf2d6d9c9ad2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:33.238271 7392 raft_consensus.cc:1261] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 1 FOLLOWER]: Refusing update from remote peer 7b7c63a7520143838bdbdf2d6d9c9ad2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:33.238940 7617 consensus_queue.cc:1035] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "100bf04226fe4d239894eb8560abe8f7" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:33.239217 7622 consensus_queue.cc:1035] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a1dbc7ef0384451b813e52a130acf6f" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 38947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:33.247292 7626 mvcc.cc:205] Tried to move back new op lower bound from 7317192512455884800 to 7317192512252370944. Current Snapshot: MvccSnapshot[applied={T|T < 7317192512455884800}]
I20260811 04:52:33.250193 7628 mvcc.cc:205] Tried to move back new op lower bound from 7317192512455884800 to 7317192512252370944. Current Snapshot: MvccSnapshot[applied={T|T < 7317192512455884800}]
I20260811 04:52:33.256096 7088 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:33.256296 7088 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48876:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:33.258774 7088 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fcd4aa54a4774a1eb1ab3f92bd189908: Sending DeleteTablet for 3 replicas of tablet 72811f0131cd407c858278577c531640
I20260811 04:52:33.259528 7370 tablet_service.cc:1514] Processing DeleteTablet for tablet 72811f0131cd407c858278577c531640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:33 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:59958
I20260811 04:52:33.259539 7519 tablet_service.cc:1514] Processing DeleteTablet for tablet 72811f0131cd407c858278577c531640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:33 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:32796
I20260811 04:52:33.259598 7225 tablet_service.cc:1514] Processing DeleteTablet for tablet 72811f0131cd407c858278577c531640 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:33 UTC) from {username='kudu', principal='kudu/127.17.188.126@KRBTEST.COM'} at 127.0.0.1:38318
I20260811 04:52:33.260036 7638 tablet_replica.cc:330] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: stopping tablet replica
I20260811 04:52:33.260216 7639 tablet_replica.cc:330] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2: stopping tablet replica
I20260811 04:52:33.260371 7638 raft_consensus.cc:2229] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:33.260496 7639 raft_consensus.cc:2229] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 1 LEADER]: Raft consensus shutting down.
I20260811 04:52:33.260685 7638 raft_consensus.cc:2258] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:33.260841 7639 raft_consensus.cc:2258] T 72811f0131cd407c858278577c531640 P 7b7c63a7520143838bdbdf2d6d9c9ad2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:33.261133 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7157
I20260811 04:52:33.261214 7637 tablet_replica.cc:330] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: stopping tablet replica
I20260811 04:52:33.261508 7637 raft_consensus.cc:2229] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:33.261936 7637 raft_consensus.cc:2258] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:33.263779 7638 ts_tablet_manager.cc:1905] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:33.263854 7637 ts_tablet_manager.cc:1905] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:33.266134 7638 ts_tablet_manager.cc:1918] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:33.266280 7638 log.cc:1196] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/72811f0131cd407c858278577c531640
I20260811 04:52:33.266607 7638 ts_tablet_manager.cc:1939] T 72811f0131cd407c858278577c531640 P 0a1dbc7ef0384451b813e52a130acf6f: Deleting consensus metadata
I20260811 04:52:33.267297 7637 ts_tablet_manager.cc:1918] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:33.267378 7637 log.cc:1196] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/72811f0131cd407c858278577c531640
I20260811 04:52:33.267717 7637 ts_tablet_manager.cc:1939] T 72811f0131cd407c858278577c531640 P 100bf04226fe4d239894eb8560abe8f7: Deleting consensus metadata
I20260811 04:52:33.267834 7073 catalog_manager.cc:4841] TS 0a1dbc7ef0384451b813e52a130acf6f (127.17.188.67:38947): tablet 72811f0131cd407c858278577c531640 (table test-table [id=a170ac69047e496eaf5fca2efdcde620]) successfully deleted
I20260811 04:52:33.268736 7075 catalog_manager.cc:4841] TS 100bf04226fe4d239894eb8560abe8f7 (127.17.188.66:44497): tablet 72811f0131cd407c858278577c531640 (table test-table [id=a170ac69047e496eaf5fca2efdcde620]) successfully deleted
W20260811 04:52:33.272939 7072 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:43495 (error 108)
I20260811 04:52:33.273211 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7304
I20260811 04:52:33.277365 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.277074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:43495 (local address 127.0.0.1:38338)
0811 04:52:33.277221 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.277288 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:43495: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 04:52:33.277678 7072 catalog_manager.cc:4584] TS 7b7c63a7520143838bdbdf2d6d9c9ad2 (127.17.188.65:43495): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 72811f0131cd407c858278577c531640: Network error: Client connection negotiation failed: client connection to 127.17.188.65:43495: connect: Connection refused (error 111)
I20260811 04:52:33.281684 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7450
I20260811 04:52:33.288551 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7053
2026-08-11T04:52:33Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2452 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T04:52:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:33Z Disabled control of system clock
I20260811 04:52:33.322047 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35843
--webserver_interface=127.17.188.126
--webserver_port=0
--builtin_ntp_servers=127.17.188.84:41833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:35843
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:33.434772 7644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:33.435052 7644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:33.435088 7644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:33.439289 7644 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:33.439355 7644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:33.439371 7644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:33.439388 7644 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:33.439440 7644 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:33.444386 7644 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:35843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:33.445655 7644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:33.447154 7644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:33.455881 7650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:33.455911 7644 server_base.cc:1034] running on GCE node
W20260811 04:52:33.455862 7651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:33.455862 7653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:33.456781 7644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:33.457970 7644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:33.459162 7644 hybrid_clock.cc:648] HybridClock initialized: now 1786423953459145 us; error 36 us; skew 500 ppm
I20260811 04:52:33.460999 7644 webserver.cc:460] Webserver started at http://127.17.188.126:39331/ using document root <none> and password file <none>
I20260811 04:52:33.461793 7644 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:33.461902 7644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:33.462144 7644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:33.464460 7644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "ba426f44fa674ae88a1d0ea508718522"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "c40146ba0a65cbaf41a3cb4ee32af17c"
server_key_iv: "a1fda1be08784fbb17440b922cd36d92"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.465034 7644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "ba426f44fa674ae88a1d0ea508718522"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "c40146ba0a65cbaf41a3cb4ee32af17c"
server_key_iv: "a1fda1be08784fbb17440b922cd36d92"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.468670 7644 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:52:33.471210 7659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.472440 7644 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:33.472573 7644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "ba426f44fa674ae88a1d0ea508718522"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "c40146ba0a65cbaf41a3cb4ee32af17c"
server_key_iv: "a1fda1be08784fbb17440b922cd36d92"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.472685 7644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:33.495085 7644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:33.495905 7644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:33.496138 7644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:33.503866 7644 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:35843
I20260811 04:52:33.503870 7715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:35843 every 8 connection(s)
I20260811 04:52:33.504880 7644 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:33.508029 7716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:33.508301 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7644
I20260811 04:52:33.508425 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:33.508761 18161 external_mini_cluster.cc:1428] Setting key ee2b6c90204fe1856b89e164c900db56
I20260811 04:52:33.514580 7716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: Bootstrap starting.
I20260811 04:52:33.517215 7716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:33.518036 7716 log.cc:824] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:33.518440 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.510309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52008 (local address 127.17.188.126:35843)
0811 04:52:33.510966 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.510985 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.511020 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:33.511665 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.511691 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.512102 (+ 411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.512379 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:33.512743 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.513787 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.514993 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.515446 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.515559 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.516518 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:33.516523 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:33.516534 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:33.516928 (+ 394us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:33.516984 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:33.517003 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:33.517081 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.517312 (+ 231us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.517639 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":140,"threads_started":1}
I20260811 04:52:33.520126 7716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: No bootstrap required, opened a new log
I20260811 04:52:33.523743 7716 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } }
I20260811 04:52:33.523954 7716 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:33.523988 7716 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba426f44fa674ae88a1d0ea508718522, State: Initialized, Role: FOLLOWER
I20260811 04:52:33.524334 7716 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } }
I20260811 04:52:33.524443 7716 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:33.524485 7716 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:33.524552 7716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:33.525396 7716 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } }
I20260811 04:52:33.525738 7716 leader_election.cc:302] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba426f44fa674ae88a1d0ea508718522; no voters:
I20260811 04:52:33.525992 7716 leader_election.cc:288] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:33.526144 7722 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:33.526407 7722 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [term 1 LEADER]: Becoming Leader. State: Replica: ba426f44fa674ae88a1d0ea508718522, State: Running, Role: LEADER
I20260811 04:52:33.526954 7722 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } }
I20260811 04:52:33.527221 7716 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:33.528577 7724 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba426f44fa674ae88a1d0ea508718522. Latest consensus state: current_term: 1 leader_uuid: "ba426f44fa674ae88a1d0ea508718522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } } }
I20260811 04:52:33.528625 7723 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba426f44fa674ae88a1d0ea508718522" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba426f44fa674ae88a1d0ea508718522" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35843 } } }
I20260811 04:52:33.528704 7724 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:33.528726 7723 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:33.529176 7733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:33.534390 7733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:33.539887 7733 catalog_manager.cc:1347] Generated new cluster ID: bd7e0f6ec15549efad382bbf049c9c7a
I20260811 04:52:33.539948 7733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:33.561529 7733 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:33.562779 7733 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:33.572067 7733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: Generated new TSK 0
I20260811 04:52:33.572824 7733 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:33.579491 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.65:0
--local_ip_for_outbound_sockets=127.17.188.65
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--builtin_ntp_servers=127.17.188.84:41833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 04:52:33.699229 7743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:33.699503 7743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:33.699592 7743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:33.703501 7743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:33.703581 7743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:33.703676 7743 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.65
I20260811 04:52:33.708746 7743 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.17.188.65
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.65
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:33.710003 7743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:33.711428 7743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:33.721099 7753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:33.721205 7743 server_base.cc:1034] running on GCE node
W20260811 04:52:33.721092 7750 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:33.721092 7751 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:33.721889 7743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:33.722441 7743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:33.723605 7743 hybrid_clock.cc:648] HybridClock initialized: now 1786423953723577 us; error 42 us; skew 500 ppm
I20260811 04:52:33.725348 7743 webserver.cc:460] Webserver started at http://127.17.188.65:39661/ using document root <none> and password file <none>
I20260811 04:52:33.725970 7743 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:33.726034 7743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:33.726204 7743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:33.728286 7743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data/instance:
uuid: "ea805a05d56a412c8b706e7caed377ba"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "ddbedfbd88565719b4fbd0f176b700fa"
server_key_iv: "bb84b28a1d5e89d85eabe95a3a313406"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.728899 7743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance:
uuid: "ea805a05d56a412c8b706e7caed377ba"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "ddbedfbd88565719b4fbd0f176b700fa"
server_key_iv: "bb84b28a1d5e89d85eabe95a3a313406"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.732553 7743 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.001s
I20260811 04:52:33.734968 7761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.736141 7743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:33.736235 7743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal
uuid: "ea805a05d56a412c8b706e7caed377ba"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "ddbedfbd88565719b4fbd0f176b700fa"
server_key_iv: "bb84b28a1d5e89d85eabe95a3a313406"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.736317 7743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:33.746135 7743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:33.746666 7743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:33.746799 7743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:33.747262 7743 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:33.748085 7743 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:33.748131 7743 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.748167 7743 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:33.748188 7743 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.756830 7743 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.65:40519
I20260811 04:52:33.756863 7887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.65:40519 every 8 connection(s)
I20260811 04:52:33.757756 7743 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/data/info.pb
I20260811 04:52:33.767680 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7743
I20260811 04:52:33.767799 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-0/wal/instance
I20260811 04:52:33.768100 18161 external_mini_cluster.cc:1428] Setting key f794f597a27c7d339ed1fadb5c9d2ad0
I20260811 04:52:33.770069 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.66:0
--local_ip_for_outbound_sockets=127.17.188.66
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--builtin_ntp_servers=127.17.188.84:41833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:33.771386 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.759475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:46227 (local address 127.17.188.126:35843)
0811 04:52:33.759650 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.759655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.760683 (+ 1028us) server_negotiation.cc:407] Connection header received
0811 04:52:33.762103 (+ 1420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.762106 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.762159 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.762232 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:33.763078 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.763621 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.764704 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.764914 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.764988 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.770890 (+ 5902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:33.770893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:33.770896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:33.770908 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:33.770930 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:33.770938 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:33.771001 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.771207 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.771272 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 04:52:33.772539 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.759896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35843 (local address 127.17.188.65:46227)
0811 04:52:33.760532 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.760570 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.761909 (+ 1339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.762395 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.762402 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.762489 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:33.762953 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.762964 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.763731 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.763733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.764594 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.764603 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.765046 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.765048 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.765194 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.770540 (+ 5346us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:33.770544 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:33.770606 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:33.770705 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:33.771029 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:33.771043 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:33.771051 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.771195 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.771537 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":117,"threads_started":1}
I20260811 04:52:33.773943 7888 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35843
I20260811 04:52:33.774204 7888 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:33.774777 7888 heartbeater.cc:511] Master 127.17.188.126:35843 requested a full tablet report, sending...
I20260811 04:52:33.776445 7678 ts_manager.cc:194] Registered new tserver with Master: ea805a05d56a412c8b706e7caed377ba (127.17.188.65:40519)
I20260811 04:52:33.777724 7678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.65:46227
W20260811 04:52:33.882478 7891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:33.882774 7891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:33.882838 7891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:33.886709 7891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:33.886780 7891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:33.886855 7891 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.66
I20260811 04:52:33.891484 7891 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.17.188.66
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.66
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:33.892563 7891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:33.894012 7891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:33.904065 7897 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:33.904096 7900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:33.904068 7898 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:33.904158 7891 server_base.cc:1034] running on GCE node
I20260811 04:52:33.904873 7891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:33.905498 7891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:33.906662 7891 hybrid_clock.cc:648] HybridClock initialized: now 1786423953906643 us; error 30 us; skew 500 ppm
I20260811 04:52:33.908504 7891 webserver.cc:460] Webserver started at http://127.17.188.66:36857/ using document root <none> and password file <none>
I20260811 04:52:33.909085 7891 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:33.909147 7891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:33.909395 7891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:33.911476 7891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data/instance:
uuid: "21982a6e19994540a2c7f9fb2b1db655"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "e6e5f62008b4166c6fba73b736273084"
server_key_iv: "7b2f23e139c3d765b6775d6855f5ec25"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.912041 7891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance:
uuid: "21982a6e19994540a2c7f9fb2b1db655"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "e6e5f62008b4166c6fba73b736273084"
server_key_iv: "7b2f23e139c3d765b6775d6855f5ec25"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.915611 7891 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260811 04:52:33.918115 7908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.919310 7891 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:33.919446 7891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal
uuid: "21982a6e19994540a2c7f9fb2b1db655"
format_stamp: "Formatted at 2026-08-11 04:52:33 on dist-test-slave-njxd"
server_key: "e6e5f62008b4166c6fba73b736273084"
server_key_iv: "7b2f23e139c3d765b6775d6855f5ec25"
server_key_version: "encryptionkey@0"
I20260811 04:52:33.919559 7891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:33.943509 7891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:33.944268 7891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:33.944480 7891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:33.945101 7891 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:33.946151 7891 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:33.946228 7891 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.946302 7891 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:33.946355 7891 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:33.955349 7891 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.66:42115
I20260811 04:52:33.955391 8037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.66:42115 every 8 connection(s)
I20260811 04:52:33.956259 7891 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/data/info.pb
I20260811 04:52:33.957525 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 7891
I20260811 04:52:33.957686 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal/instance
I20260811 04:52:33.958092 18161 external_mini_cluster.cc:1428] Setting key cccfdc0a229e3c464590599d1c0d1aae
I20260811 04:52:33.960088 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.17.188.67:0
--local_ip_for_outbound_sockets=127.17.188.67
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--builtin_ntp_servers=127.17.188.84:41833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 04:52:33.966198 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.958238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.66:50571 (local address 127.17.188.126:35843)
0811 04:52:33.958415 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:33.958420 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:33.959583 (+ 1163us) server_negotiation.cc:407] Connection header received
0811 04:52:33.961085 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:33.961091 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:33.961153 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:33.961247 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:33.962201 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.962750 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.963900 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.964279 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.964401 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.965528 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:33.965535 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:33.965542 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:33.965561 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:33.965604 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:33.965619 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:33.965722 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:33.965905 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 04:52:33.965981 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 04:52:33.966940 8040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:33.958688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35843 (local address 127.17.188.66:50571)
0811 04:52:33.959422 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:33.959476 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:33.960876 (+ 1400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:33.961405 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:33.961412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:33.961494 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:33.962046 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.962059 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.962887 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.962891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.963766 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:33.963775 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:33.964436 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:33.964439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:33.964591 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:33.965240 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:33.965242 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:33.965280 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:33.965343 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:33.965718 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:33.965726 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:33.965730 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:52:33.965890 (+ 160us) client_negotiation.cc:240] Negotiation successful
0811 04:52:33.966106 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":131,"threads_started":1}
I20260811 04:52:33.968320 8038 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35843
I20260811 04:52:33.968596 8038 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:33.969280 8038 heartbeater.cc:511] Master 127.17.188.126:35843 requested a full tablet report, sending...
I20260811 04:52:33.970539 7678 ts_manager.cc:194] Registered new tserver with Master: 21982a6e19994540a2c7f9fb2b1db655 (127.17.188.66:42115)
I20260811 04:52:33.971187 7678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.66:50571
W20260811 04:52:34.074965 8041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:34.075268 8041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:34.075374 8041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:34.079627 8041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:34.079715 8041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:34.079804 8041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.17.188.67
I20260811 04:52:34.084649 8041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.17.188.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.17.188.67
--webserver_port=0
--tserver_master_addrs=127.17.188.126:35843
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8041
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.17.188.67
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:34.085834 8041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:34.087227 8041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:34.096660 8050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:34.096719 8048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:34.096652 8047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:34.096885 8041 server_base.cc:1034] running on GCE node
I20260811 04:52:34.097378 8041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:34.098073 8041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:34.099267 8041 hybrid_clock.cc:648] HybridClock initialized: now 1786423954099255 us; error 32 us; skew 500 ppm
I20260811 04:52:34.101145 8041 webserver.cc:460] Webserver started at http://127.17.188.67:39217/ using document root <none> and password file <none>
I20260811 04:52:34.101789 8041 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:34.101881 8041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:34.102111 8041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:34.104102 8041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data/instance:
uuid: "6e58c426ded64b27bed1462297d62c90"
format_stamp: "Formatted at 2026-08-11 04:52:34 on dist-test-slave-njxd"
server_key: "2bd5e39c9a38802ab1fb0d433da7c7ce"
server_key_iv: "ca8c1f8f4c47711d53b734cf294540ab"
server_key_version: "encryptionkey@0"
I20260811 04:52:34.104665 8041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance:
uuid: "6e58c426ded64b27bed1462297d62c90"
format_stamp: "Formatted at 2026-08-11 04:52:34 on dist-test-slave-njxd"
server_key: "2bd5e39c9a38802ab1fb0d433da7c7ce"
server_key_iv: "ca8c1f8f4c47711d53b734cf294540ab"
server_key_version: "encryptionkey@0"
I20260811 04:52:34.108237 8041 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 04:52:34.110733 8056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:34.111930 8041 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:34.112071 8041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal
uuid: "6e58c426ded64b27bed1462297d62c90"
format_stamp: "Formatted at 2026-08-11 04:52:34 on dist-test-slave-njxd"
server_key: "2bd5e39c9a38802ab1fb0d433da7c7ce"
server_key_iv: "ca8c1f8f4c47711d53b734cf294540ab"
server_key_version: "encryptionkey@0"
I20260811 04:52:34.112185 8041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:34.121728 8041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:34.122359 8041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:34.122555 8041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:34.123140 8041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 04:52:34.124049 8041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 04:52:34.124119 8041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:34.124188 8041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 04:52:34.124236 8041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:34.133195 8041 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.67:43243
I20260811 04:52:34.133229 8182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.67:43243 every 8 connection(s)
I20260811 04:52:34.134158 8041 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/data/info.pb
I20260811 04:52:34.138417 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8041
I20260811 04:52:34.138536 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal/instance
I20260811 04:52:34.138857 18161 external_mini_cluster.cc:1428] Setting key 01ffc9b6b012aa009bd12769178dede4
I20260811 04:52:34.143338 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.135872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.67:52583 (local address 127.17.188.126:35843)
0811 04:52:34.136015 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.136018 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.137011 (+ 993us) server_negotiation.cc:407] Connection header received
0811 04:52:34.138454 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.138461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.138526 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.138617 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:34.139639 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.140404 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.141665 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.141879 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.141957 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.142944 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:34.142946 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:34.142948 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:34.142959 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:34.142976 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:34.142984 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:34.143041 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.143189 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.143234 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:52:34.144141 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.136254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:35843 (local address 127.17.188.67:52583)
0811 04:52:34.136871 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.136910 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.138232 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.138798 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.138804 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.138886 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:52:34.139492 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.139514 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.140514 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.140516 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.141507 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.141516 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.142012 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.142015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.142159 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.142716 (+ 557us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 04:52:34.142717 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:52:34.142755 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 04:52:34.142812 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:52:34.143055 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:52:34.143062 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:52:34.143066 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.143164 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.143362 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":117,"threads_started":1}
I20260811 04:52:34.145252 8183 heartbeater.cc:347] Connected to a master server at 127.17.188.126:35843
I20260811 04:52:34.145447 8183 heartbeater.cc:464] Registering TS with master...
I20260811 04:52:34.145915 8183 heartbeater.cc:511] Master 127.17.188.126:35843 requested a full tablet report, sending...
I20260811 04:52:34.146878 7678 ts_manager.cc:194] Registered new tserver with Master: 6e58c426ded64b27bed1462297d62c90 (127.17.188.67:43243)
I20260811 04:52:34.147434 7678 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.17.188.67:52583
I20260811 04:52:34.152652 18161 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 04:52:34.158576 7720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.154604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.17.188.126:35843)
0811 04:52:34.154750 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.154754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.154972 (+ 218us) server_negotiation.cc:407] Connection header received
0811 04:52:34.155117 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.155122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.155171 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.155254 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:34.155549 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.156030 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.156882 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.157093 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.157204 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.158070 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:34.158074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:34.158077 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:34.158088 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:34.158111 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:34.158118 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:34.158205 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.158354 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.158404 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 04:52:34.161217 7678 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 04:52:34.164268 7678 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 04:52:34.178380 8198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.172791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40519 (local address 127.0.0.1:59178)
0811 04:52:34.173157 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.173173 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.173263 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.174147 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.174153 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.174177 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:34.174327 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.174334 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.175468 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.175474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.176742 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.176754 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.177803 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.177807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.177907 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.177965 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.178088 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.178225 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":2,"thread_start_us":90,"threads_started":1}
I20260811 04:52:34.178439 8200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.173118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59178 (local address 127.17.188.65:40519)
0811 04:52:34.173613 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.173626 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.173653 (+ 27us) server_negotiation.cc:407] Connection header received
0811 04:52:34.173738 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.173745 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.173979 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.174167 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:34.174477 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.175349 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.176887 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.177680 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.177787 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.177993 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.178144 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.178272 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":135,"threads_started":1}
I20260811 04:52:34.178699 8199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.173120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43243 (local address 127.0.0.1:60806)
0811 04:52:34.173461 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.173474 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.173550 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.174377 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.174380 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.174414 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:34.174518 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.174527 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.175912 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.175915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.177213 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.177224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.178293 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.178297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.178395 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.178418 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.178472 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.178545 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":60,"thread_start_us":90,"threads_started":1}
I20260811 04:52:34.178900 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.172397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:42115 (local address 127.0.0.1:39212)
0811 04:52:34.172947 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.172998 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.173126 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.174325 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.174328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.174342 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:34.174661 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.174667 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.176040 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.176081 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.177300 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.177308 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.178469 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.178473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.178568 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.178589 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.178662 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.178742 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":3,"thread_start_us":93,"threads_started":1}
I20260811 04:52:34.179306 8197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.172541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39212 (local address 127.17.188.66:42115)
0811 04:52:34.173899 (+ 1358us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.173912 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.173935 (+ 23us) server_negotiation.cc:407] Connection header received
0811 04:52:34.174012 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.174018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.174192 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.174352 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:34.174780 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.175892 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.177390 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.178121 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.178225 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.178399 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.179084 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.179183 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1233,"thread_start_us":136,"threads_started":1}
I20260811 04:52:34.179893 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.173539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60806 (local address 127.17.188.67:43243)
0811 04:52:34.173992 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.174002 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.174020 (+ 18us) server_negotiation.cc:407] Connection header received
0811 04:52:34.174079 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.174083 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.174232 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.174482 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:34.174613 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.175749 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.177339 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.178159 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.179412 (+ 1253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.179591 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.179650 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.179745 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":167,"threads_started":1}
I20260811 04:52:34.181529 7815 tablet_service.cc:1467] Processing CreateTablet for tablet 9659d3f4d8564fae951ac4826f73d90a (DEFAULT_TABLE table=test-table [id=d1c0b8589e3b496185cde4f31836d59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:34.182201 8109 tablet_service.cc:1467] Processing CreateTablet for tablet 9659d3f4d8564fae951ac4826f73d90a (DEFAULT_TABLE table=test-table [id=d1c0b8589e3b496185cde4f31836d59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:34.182680 7815 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9659d3f4d8564fae951ac4826f73d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:34.183100 8109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9659d3f4d8564fae951ac4826f73d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:34.184605 7964 tablet_service.cc:1467] Processing CreateTablet for tablet 9659d3f4d8564fae951ac4826f73d90a (DEFAULT_TABLE table=test-table [id=d1c0b8589e3b496185cde4f31836d59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 04:52:34.185632 7964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9659d3f4d8564fae951ac4826f73d90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:34.190747 8203 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Bootstrap starting.
I20260811 04:52:34.191581 8202 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Bootstrap starting.
I20260811 04:52:34.192835 8204 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Bootstrap starting.
I20260811 04:52:34.193074 8203 tablet_bootstrap.cc:654] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:34.193799 8202 tablet_bootstrap.cc:654] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:34.193993 8203 log.cc:824] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:34.194628 8202 log.cc:824] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:34.194988 8204 tablet_bootstrap.cc:654] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:34.195719 8204 log.cc:824] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:34.196100 8203 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: No bootstrap required, opened a new log
I20260811 04:52:34.196305 8203 ts_tablet_manager.cc:1397] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 04:52:34.196607 8202 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: No bootstrap required, opened a new log
I20260811 04:52:34.196805 8202 ts_tablet_manager.cc:1397] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 04:52:34.197623 8204 tablet_bootstrap.cc:492] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: No bootstrap required, opened a new log
I20260811 04:52:34.197800 8204 ts_tablet_manager.cc:1397] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260811 04:52:34.200034 8202 raft_consensus.cc:348] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.200282 8202 raft_consensus.cc:374] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:34.200353 8202 raft_consensus.cc:729] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e58c426ded64b27bed1462297d62c90, State: Initialized, Role: FOLLOWER
I20260811 04:52:34.200608 8203 raft_consensus.cc:348] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.200846 8203 raft_consensus.cc:374] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:34.200788 8202 consensus_queue.cc:260] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.200903 8203 raft_consensus.cc:729] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea805a05d56a412c8b706e7caed377ba, State: Initialized, Role: FOLLOWER
I20260811 04:52:34.201352 8203 consensus_queue.cc:260] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.201684 8202 ts_tablet_manager.cc:1428] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 04:52:34.201771 8204 raft_consensus.cc:348] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.202003 8204 raft_consensus.cc:374] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:34.202020 8183 heartbeater.cc:503] Master 127.17.188.126:35843 was elected leader, sending a full tablet report...
I20260811 04:52:34.202062 8204 raft_consensus.cc:729] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21982a6e19994540a2c7f9fb2b1db655, State: Initialized, Role: FOLLOWER
I20260811 04:52:34.202296 8203 ts_tablet_manager.cc:1428] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260811 04:52:34.202441 8204 consensus_queue.cc:260] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.202648 7888 heartbeater.cc:503] Master 127.17.188.126:35843 was elected leader, sending a full tablet report...
I20260811 04:52:34.203080 8038 heartbeater.cc:503] Master 127.17.188.126:35843 was elected leader, sending a full tablet report...
I20260811 04:52:34.203307 8204 ts_tablet_manager.cc:1428] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260811 04:52:34.207175 8039 tablet.cc:2369] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:34.234565 8209 raft_consensus.cc:482] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 04:52:34.234766 8209 raft_consensus.cc:504] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.236119 8209 leader_election.cc:288] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 21982a6e19994540a2c7f9fb2b1db655 (127.17.188.66:42115), 6e58c426ded64b27bed1462297d62c90 (127.17.188.67:43243)
I20260811 04:52:34.240468 8197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.236588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:55859 (local address 127.17.188.66:42115)
0811 04:52:34.236739 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.236743 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.236758 (+ 15us) server_negotiation.cc:407] Connection header received
0811 04:52:34.236849 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.236855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.236911 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.237011 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:34.237369 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.238085 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.239358 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.239960 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.240070 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.240109 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.240311 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.240367 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 04:52:34.240496 7890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.236452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.66:42115 (local address 127.17.188.65:55859)
0811 04:52:34.236643 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.236662 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.236753 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.237128 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.237156 (+ 28us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.237174 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:34.237270 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.237276 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.238191 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.238195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.239260 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.239270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.240072 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.240076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.240192 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.240219 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.240295 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.240367 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 04:52:34.241195 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.236915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.17.188.65:54983 (local address 127.17.188.67:43243)
0811 04:52:34.237052 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.237056 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.237253 (+ 197us) server_negotiation.cc:407] Connection header received
0811 04:52:34.237427 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.237430 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.237476 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.237534 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 04:52:34.237888 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.238604 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.239981 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.240651 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.240784 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.240830 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.241047 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.241105 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 04:52:34.241228 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.236797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.67:43243 (local address 127.17.188.65:54983)
0811 04:52:34.237153 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.237172 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 04:52:34.237295 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:52:34.237606 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:52:34.237609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:52:34.237627 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 04:52:34.237748 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.237754 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.238734 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.238737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.239866 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:52:34.239877 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.240798 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.240801 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:52:34.240904 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.240942 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 04:52:34.241024 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 04:52:34.241090 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":103,"threads_started":1}
I20260811 04:52:34.241262 7986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9659d3f4d8564fae951ac4826f73d90a" candidate_uuid: "ea805a05d56a412c8b706e7caed377ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21982a6e19994540a2c7f9fb2b1db655" is_pre_election: true
I20260811 04:52:34.241549 7986 raft_consensus.cc:2454] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea805a05d56a412c8b706e7caed377ba in term 0.
I20260811 04:52:34.242105 7765 leader_election.cc:302] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21982a6e19994540a2c7f9fb2b1db655, ea805a05d56a412c8b706e7caed377ba; no voters:
I20260811 04:52:34.242144 8133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9659d3f4d8564fae951ac4826f73d90a" candidate_uuid: "ea805a05d56a412c8b706e7caed377ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e58c426ded64b27bed1462297d62c90" is_pre_election: true
I20260811 04:52:34.242405 8133 raft_consensus.cc:2454] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea805a05d56a412c8b706e7caed377ba in term 0.
I20260811 04:52:34.242403 8209 raft_consensus.cc:2781] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 04:52:34.242493 8209 raft_consensus.cc:482] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 04:52:34.242571 8209 raft_consensus.cc:3037] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:34.243718 8209 raft_consensus.cc:504] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.244083 8209 leader_election.cc:288] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [CANDIDATE]: Term 1 election: Requested vote from peers 21982a6e19994540a2c7f9fb2b1db655 (127.17.188.66:42115), 6e58c426ded64b27bed1462297d62c90 (127.17.188.67:43243)
I20260811 04:52:34.244445 7986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9659d3f4d8564fae951ac4826f73d90a" candidate_uuid: "ea805a05d56a412c8b706e7caed377ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21982a6e19994540a2c7f9fb2b1db655"
I20260811 04:52:34.244447 8133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9659d3f4d8564fae951ac4826f73d90a" candidate_uuid: "ea805a05d56a412c8b706e7caed377ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e58c426ded64b27bed1462297d62c90"
I20260811 04:52:34.244566 8133 raft_consensus.cc:3037] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:34.244545 7986 raft_consensus.cc:3037] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:34.245627 7986 raft_consensus.cc:2454] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea805a05d56a412c8b706e7caed377ba in term 1.
I20260811 04:52:34.245661 8133 raft_consensus.cc:2454] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea805a05d56a412c8b706e7caed377ba in term 1.
I20260811 04:52:34.245950 7765 leader_election.cc:302] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21982a6e19994540a2c7f9fb2b1db655, ea805a05d56a412c8b706e7caed377ba; no voters:
I20260811 04:52:34.246136 8209 raft_consensus.cc:2781] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:34.246383 8209 raft_consensus.cc:686] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [term 1 LEADER]: Becoming Leader. State: Replica: ea805a05d56a412c8b706e7caed377ba, State: Running, Role: LEADER
I20260811 04:52:34.246709 8209 consensus_queue.cc:237] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } }
I20260811 04:52:34.249941 7677 catalog_manager.cc:5495] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba reported cstate change: term changed from 0 to 1, leader changed from <none> to ea805a05d56a412c8b706e7caed377ba (127.17.188.65). New cstate: current_term: 1 leader_uuid: "ea805a05d56a412c8b706e7caed377ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea805a05d56a412c8b706e7caed377ba" member_type: VOTER last_known_addr { host: "127.17.188.65" port: 40519 } health_report { overall_health: HEALTHY } } }
W20260811 04:52:34.258908 7889 tablet.cc:2369] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:52:34.279027 8200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.275290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.17.188.65:40519)
0811 04:52:34.275442 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:34.275447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:34.275463 (+ 16us) server_negotiation.cc:407] Connection header received
0811 04:52:34.275595 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:34.275597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:34.275658 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:34.275775 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:52:34.276020 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.276610 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.277467 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:34.277754 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:34.277869 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:34.278200 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:52:34.278620 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:52:34.278762 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:34.278821 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 04:52:34.278879 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:52:34.285130 8133 raft_consensus.cc:1261] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 1 FOLLOWER]: Refusing update from remote peer ea805a05d56a412c8b706e7caed377ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:34.285136 7986 raft_consensus.cc:1261] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 1 FOLLOWER]: Refusing update from remote peer ea805a05d56a412c8b706e7caed377ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:52:34.285987 8213 consensus_queue.cc:1035] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "21982a6e19994540a2c7f9fb2b1db655" member_type: VOTER last_known_addr { host: "127.17.188.66" port: 42115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:34.286191 8209 consensus_queue.cc:1035] T 9659d3f4d8564fae951ac4826f73d90a P ea805a05d56a412c8b706e7caed377ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e58c426ded64b27bed1462297d62c90" member_type: VOTER last_known_addr { host: "127.17.188.67" port: 43243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:52:34.294286 8217 mvcc.cc:205] Tried to move back new op lower bound from 7317192516743430144 to 7317192516597305344. Current Snapshot: MvccSnapshot[applied={T|T < 7317192516743430144}]
I20260811 04:52:34.294410 8216 mvcc.cc:205] Tried to move back new op lower bound from 7317192516743430144 to 7317192516597305344. Current Snapshot: MvccSnapshot[applied={T|T < 7317192516743430144}]
I20260811 04:52:34.296360 8218 mvcc.cc:205] Tried to move back new op lower bound from 7317192516743430144 to 7317192516597305344. Current Snapshot: MvccSnapshot[applied={T|T < 7317192516743430144}]
I20260811 04:52:34.302848 7678 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:34.302989 7678 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 04:52:34.305305 7678 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ba426f44fa674ae88a1d0ea508718522: Sending DeleteTablet for 3 replicas of tablet 9659d3f4d8564fae951ac4826f73d90a
I20260811 04:52:34.306161 7815 tablet_service.cc:1514] Processing DeleteTablet for tablet 9659d3f4d8564fae951ac4826f73d90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:34 UTC) from {username='slave'} at 127.0.0.1:59178
I20260811 04:52:34.306272 7964 tablet_service.cc:1514] Processing DeleteTablet for tablet 9659d3f4d8564fae951ac4826f73d90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:34 UTC) from {username='slave'} at 127.0.0.1:39212
I20260811 04:52:34.306411 8109 tablet_service.cc:1514] Processing DeleteTablet for tablet 9659d3f4d8564fae951ac4826f73d90a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 04:52:34 UTC) from {username='slave'} at 127.0.0.1:60806
I20260811 04:52:34.306763 8228 tablet_replica.cc:330] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: stopping tablet replica
I20260811 04:52:34.306938 8229 tablet_replica.cc:330] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: stopping tablet replica
I20260811 04:52:34.307086 8228 raft_consensus.cc:2229] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:34.307235 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7743
I20260811 04:52:34.307406 8229 raft_consensus.cc:2229] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 04:52:34.307806 8229 raft_consensus.cc:2258] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:34.307410 8228 raft_consensus.cc:2258] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 04:52:34.311451 8228 ts_tablet_manager.cc:1905] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:34.312481 8229 ts_tablet_manager.cc:1905] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 04:52:34.314656 8229 ts_tablet_manager.cc:1918] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:34.314769 8229 log.cc:1196] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-2/wal/wals/9659d3f4d8564fae951ac4826f73d90a
I20260811 04:52:34.315044 8229 ts_tablet_manager.cc:1939] T 9659d3f4d8564fae951ac4826f73d90a P 6e58c426ded64b27bed1462297d62c90: Deleting consensus metadata
I20260811 04:52:34.315042 8228 ts_tablet_manager.cc:1918] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 04:52:34.315205 8228 log.cc:1196] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Deleting WAL directory at /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786423695299078-18161-0/minicluster-data/ts-1/wal/wals/9659d3f4d8564fae951ac4826f73d90a
I20260811 04:52:34.315543 8228 ts_tablet_manager.cc:1939] T 9659d3f4d8564fae951ac4826f73d90a P 21982a6e19994540a2c7f9fb2b1db655: Deleting consensus metadata
I20260811 04:52:34.316274 7662 catalog_manager.cc:4841] TS 6e58c426ded64b27bed1462297d62c90 (127.17.188.67:43243): tablet 9659d3f4d8564fae951ac4826f73d90a (table test-table [id=d1c0b8589e3b496185cde4f31836d59c]) successfully deleted
I20260811 04:52:34.316787 7662 catalog_manager.cc:4841] TS 21982a6e19994540a2c7f9fb2b1db655 (127.17.188.66:42115): tablet 9659d3f4d8564fae951ac4826f73d90a (table test-table [id=d1c0b8589e3b496185cde4f31836d59c]) successfully deleted
W20260811 04:52:34.319491 7664 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.17.188.65:40519 (error 108)
I20260811 04:52:34.319718 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7891
I20260811 04:52:34.322180 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:34.321779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.65:40519 (local address 127.0.0.1:59202)
0811 04:52:34.321958 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 04:52:34.322061 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.65:40519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 04:52:34.322425 7664 catalog_manager.cc:4584] TS ea805a05d56a412c8b706e7caed377ba (127.17.188.65:40519): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9659d3f4d8564fae951ac4826f73d90a: Network error: Client connection negotiation failed: client connection to 127.17.188.65:40519: connect: Connection refused (error 111)
I20260811 04:52:34.327665 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8041
I20260811 04:52:34.335829 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 7644
2026-08-11T04:52:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1046 ms)
[----------] 6 tests from EncryptionPolicyTest (10669 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:34 dist-test-slave-njxd krb5kdc[8233](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:34 dist-test-slave-njxd krb5kdc[8233](info): set up 2 sockets
Aug 11 04:52:34 dist-test-slave-njxd krb5kdc[8233](info): commencing operation
krb5kdc: starting...
W20260811 04:52:35.422948 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:35.554838 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37005
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:35.670102 8247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:35.670424 8247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:35.670508 8247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:35.674563 8247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:35.674664 8247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:35.674702 8247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:35.674731 8247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:35.674772 8247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:35.680160 8247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37005
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:35.681288 8247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:35.682408 8247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:35.691005 8254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:35.690975 8257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:35.690989 8253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:35.691342 8247 server_base.cc:1034] running on GCE node
I20260811 04:52:35.691951 8247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:35.693035 8247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:35.694196 8247 hybrid_clock.cc:648] HybridClock initialized: now 1786423955694190 us; error 46 us; skew 500 ppm
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8233](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423955, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:35.703696 8247 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:35.704668 8247 webserver.cc:460] Webserver started at http://127.0.0.1:42607/ using document root <none> and password file <none>
I20260811 04:52:35.705251 8247 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:35.705353 8247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:35.705667 8247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:35.707719 8247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "a48f6f1597b94c05b9f2a75593a5838e"
format_stamp: "Formatted at 2026-08-11 04:52:35 on dist-test-slave-njxd"
server_key: "1c315eeb045f068995c6506058326626"
server_key_iv: "cb206ae93c6b3c6e18fef1d22af0dc8c"
server_key_version: "encryptionkey@0"
I20260811 04:52:35.708282 8247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "a48f6f1597b94c05b9f2a75593a5838e"
format_stamp: "Formatted at 2026-08-11 04:52:35 on dist-test-slave-njxd"
server_key: "1c315eeb045f068995c6506058326626"
server_key_iv: "cb206ae93c6b3c6e18fef1d22af0dc8c"
server_key_version: "encryptionkey@0"
I20260811 04:52:35.711897 8247 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.005s
I20260811 04:52:35.714231 8266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:35.715417 8247 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.002s
I20260811 04:52:35.715561 8247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "a48f6f1597b94c05b9f2a75593a5838e"
format_stamp: "Formatted at 2026-08-11 04:52:35 on dist-test-slave-njxd"
server_key: "1c315eeb045f068995c6506058326626"
server_key_iv: "cb206ae93c6b3c6e18fef1d22af0dc8c"
server_key_version: "encryptionkey@0"
I20260811 04:52:35.715680 8247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:35.754431 8247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:35.759112 8247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:35.759378 8247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:35.769047 8247 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37005
I20260811 04:52:35.769073 8322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37005 every 8 connection(s)
I20260811 04:52:35.770341 8247 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:35.772480 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8247
I20260811 04:52:35.772642 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:35.773020 18161 external_mini_cluster.cc:1428] Setting key 361b74c12e752ca3bfec7a4a72184c0c
I20260811 04:52:35.775586 8324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:35.782582 8324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e: Bootstrap starting.
I20260811 04:52:35.785347 8324 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:35.786501 8324 log.cc:824] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e: Log is configured to *not* fsync() on all Append() calls
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8233](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423955, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 04:52:35.788723 8324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e: No bootstrap required, opened a new log
I20260811 04:52:35.792546 8324 raft_consensus.cc:348] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } }
I20260811 04:52:35.792865 8324 raft_consensus.cc:374] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:35.792937 8324 raft_consensus.cc:729] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a48f6f1597b94c05b9f2a75593a5838e, State: Initialized, Role: FOLLOWER
I20260811 04:52:35.793526 8324 consensus_queue.cc:260] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } }
I20260811 04:52:35.793752 8324 raft_consensus.cc:388] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:35.793839 8324 raft_consensus.cc:482] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:35.793956 8324 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:35.795109 8324 raft_consensus.cc:504] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } }
I20260811 04:52:35.795491 8324 leader_election.cc:302] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a48f6f1597b94c05b9f2a75593a5838e; no voters:
I20260811 04:52:35.795881 8324 leader_election.cc:288] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:35.795987 8329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:35.796233 8329 raft_consensus.cc:686] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [term 1 LEADER]: Becoming Leader. State: Replica: a48f6f1597b94c05b9f2a75593a5838e, State: Running, Role: LEADER
I20260811 04:52:35.796550 8329 consensus_queue.cc:237] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } }
I20260811 04:52:35.797103 8327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:35.774639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35915 (local address 127.0.0.1:37005)
0811 04:52:35.775159 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:35.775184 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:35.775242 (+ 58us) server_negotiation.cc:407] Connection header received
0811 04:52:35.776039 (+ 797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:35.776058 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:35.776395 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:35.776726 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:35.777532 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:35.779038 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:35.780349 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:35.781169 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:35.781342 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:35.788683 (+ 7341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:35.788689 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:35.788704 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:35.788739 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:35.792820 (+ 4081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:35.793562 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:35.793593 (+ 31us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:35.793603 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:35.793847 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:35.794323 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:35.794326 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:35.794328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:35.794877 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:35.795091 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:35.795823 (+ 732us) server_negotiation.cc:299] Negotiation successful
0811 04:52:35.796108 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":162,"threads_started":1}
I20260811 04:52:35.797181 8324 sys_catalog.cc:564] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:35.798435 8331 sys_catalog.cc:455] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a48f6f1597b94c05b9f2a75593a5838e. Latest consensus state: current_term: 1 leader_uuid: "a48f6f1597b94c05b9f2a75593a5838e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } } }
I20260811 04:52:35.798435 8330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a48f6f1597b94c05b9f2a75593a5838e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a48f6f1597b94c05b9f2a75593a5838e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37005 } } }
I20260811 04:52:35.798625 8330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:35.799007 8334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:35.798923 8331 sys_catalog.cc:458] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:35.800237 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:35.802068 8334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:35.808050 8334 catalog_manager.cc:1347] Generated new cluster ID: a92e0ca492fb42778592f83ca10ea46c
I20260811 04:52:35.808123 8334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:35.812909 8327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:35.802821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44891 (local address 127.0.0.1:37005)
0811 04:52:35.802925 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:35.802932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:35.803210 (+ 278us) server_negotiation.cc:407] Connection header received
0811 04:52:35.803331 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:35.803334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:35.803375 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:35.803466 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:35.804254 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:35.804965 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:35.806096 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:35.806443 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:35.806549 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:35.808252 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:35.808256 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:35.808258 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:35.808281 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:35.811084 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:35.811600 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:35.811604 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:35.811606 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:35.811710 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:35.812026 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:35.812030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:35.812032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:35.812248 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:35.812416 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:35.812641 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 04:52:35.812738 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 04:52:35.822029 8334 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:35.823186 8334 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:35.832926 8334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a48f6f1597b94c05b9f2a75593a5838e: Generated new TSK 0
I20260811 04:52:35.833640 8334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:35.839553 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8247
W20260811 04:52:35.848337 8231 connection.cc:535] client connection to 127.0.0.1:37005 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37005): Connection reset by peer (error 104)
2026-08-11T04:52:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8357](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8357](info): set up 2 sockets
Aug 11 04:52:35 dist-test-slave-njxd krb5kdc[8357](info): commencing operation
krb5kdc: starting...
W20260811 04:52:36.934849 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.072s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:37 dist-test-slave-njxd krb5kdc[8357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423957, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:37.062531 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42375
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45889
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42375
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:37.176355 8371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:37.176645 8371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:37.176723 8371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:37.180738 8371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:37.180827 8371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:37.180867 8371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:37.180927 8371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:37.180968 8371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:37.186254 8371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45889
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42375
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:37.187305 8371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:37.188340 8371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:37.196775 8376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:37.196775 8379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:37.196790 8377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:37.196838 8371 server_base.cc:1034] running on GCE node
I20260811 04:52:37.197563 8371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:37.198657 8371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:37.199826 8371 hybrid_clock.cc:648] HybridClock initialized: now 1786423957199803 us; error 32 us; skew 500 ppm
Aug 11 04:52:37 dist-test-slave-njxd krb5kdc[8357](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423957, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:37.203460 8371 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:37.204370 8371 webserver.cc:460] Webserver started at http://127.0.0.1:36275/ using document root <none> and password file <none>
I20260811 04:52:37.204890 8371 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:37.204948 8371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:37.205116 8371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:37.207206 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "bc7932189afd489db9ab206e8b68abe2"
format_stamp: "Formatted at 2026-08-11 04:52:37 on dist-test-slave-njxd"
server_key: "b80a078b8b4d6e7625feade88c676eda"
server_key_iv: "e9d09bf594df615d6717c5cd68f8488b"
server_key_version: "encryptionkey@0"
I20260811 04:52:37.207728 8371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "bc7932189afd489db9ab206e8b68abe2"
format_stamp: "Formatted at 2026-08-11 04:52:37 on dist-test-slave-njxd"
server_key: "b80a078b8b4d6e7625feade88c676eda"
server_key_iv: "e9d09bf594df615d6717c5cd68f8488b"
server_key_version: "encryptionkey@0"
I20260811 04:52:37.211427 8371 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:37.213855 8386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:37.215087 8371 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:37.215195 8371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "bc7932189afd489db9ab206e8b68abe2"
format_stamp: "Formatted at 2026-08-11 04:52:37 on dist-test-slave-njxd"
server_key: "b80a078b8b4d6e7625feade88c676eda"
server_key_iv: "e9d09bf594df615d6717c5cd68f8488b"
server_key_version: "encryptionkey@0"
I20260811 04:52:37.215277 8371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:37.230188 8371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:37.234769 8371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:37.234969 8371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:37.243197 8371 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42375
I20260811 04:52:37.243218 8445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42375 every 8 connection(s)
I20260811 04:52:37.244186 8371 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:37.246955 8446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:37.248890 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8371
I20260811 04:52:37.249032 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:37.249362 18161 external_mini_cluster.cc:1428] Setting key 92202da1a167445c0fd487c2a64d44f0
I20260811 04:52:37.253372 8446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2: Bootstrap starting.
I20260811 04:52:37.255582 8446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:37.256435 8446 log.cc:824] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:37.258189 8449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:37.250772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34837 (local address 127.0.0.1:42375)
0811 04:52:37.251204 (+ 432us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:37.251219 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:37.251254 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:37.251899 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:37.251916 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:37.252237 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:37.252566 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:37.252976 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:37.254033 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:37.254940 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:37.255401 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:37.255570 (+ 169us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:37.256448 (+ 878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:37.256453 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:37.256465 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:37.256895 (+ 430us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:37.256951 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:37.256973 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:37.257112 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:37.257307 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 04:52:37.257444 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":126,"threads_started":1}
I20260811 04:52:37.258479 8446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2: No bootstrap required, opened a new log
I20260811 04:52:37.261042 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:37.262200 8446 raft_consensus.cc:348] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } }
I20260811 04:52:37.262485 8446 raft_consensus.cc:374] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:37.262564 8446 raft_consensus.cc:729] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc7932189afd489db9ab206e8b68abe2, State: Initialized, Role: FOLLOWER
I20260811 04:52:37.262964 8446 consensus_queue.cc:260] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } }
I20260811 04:52:37.263111 8446 raft_consensus.cc:388] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:37.263186 8446 raft_consensus.cc:482] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:37.263295 8446 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:37.264453 8446 raft_consensus.cc:504] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } }
I20260811 04:52:37.264796 8446 leader_election.cc:302] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bc7932189afd489db9ab206e8b68abe2; no voters:
I20260811 04:52:37.265129 8446 leader_election.cc:288] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:37.265241 8457 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:37.265475 8457 raft_consensus.cc:686] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [term 1 LEADER]: Becoming Leader. State: Replica: bc7932189afd489db9ab206e8b68abe2, State: Running, Role: LEADER
I20260811 04:52:37.265930 8457 consensus_queue.cc:237] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } }
I20260811 04:52:37.266557 8446 sys_catalog.cc:564] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:37.267887 8458 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bc7932189afd489db9ab206e8b68abe2. Latest consensus state: current_term: 1 leader_uuid: "bc7932189afd489db9ab206e8b68abe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } } }
I20260811 04:52:37.268023 8458 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:37.268065 8449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:37.263183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56113 (local address 127.0.0.1:42375)
0811 04:52:37.263298 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:37.263304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:37.263477 (+ 173us) server_negotiation.cc:407] Connection header received
0811 04:52:37.263587 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:37.263591 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:37.263637 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:37.263722 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:37.263947 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:37.264734 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:37.265876 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:37.266217 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:37.266325 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:37.267273 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:37.267278 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:37.267283 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:37.267299 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:37.267328 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:37.267344 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:37.267446 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:37.267807 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 04:52:37.267847 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":49}
I20260811 04:52:37.268257 8459 sys_catalog.cc:455] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bc7932189afd489db9ab206e8b68abe2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bc7932189afd489db9ab206e8b68abe2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42375 } } }
I20260811 04:52:37.268342 8459 sys_catalog.cc:458] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:37.268962 8466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:37.271626 8466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:37.277034 8466 catalog_manager.cc:1347] Generated new cluster ID: 3f428b9ea1dd473980f62f53b5afbab2
I20260811 04:52:37.277100 8466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:37.281843 8466 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:37.282989 8466 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:37.290093 8466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bc7932189afd489db9ab206e8b68abe2: Generated new TSK 0
I20260811 04:52:37.290725 8466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:37.295346 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8371
W20260811 04:52:37.305437 8355 connection.cc:535] client connection to 127.0.0.1:42375 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42375): Connection reset by peer (error 104)
2026-08-11T04:52:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:37 dist-test-slave-njxd krb5kdc[8480](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:37 dist-test-slave-njxd krb5kdc[8480](info): set up 2 sockets
Aug 11 04:52:37 dist-test-slave-njxd krb5kdc[8480](info): commencing operation
krb5kdc: starting...
W20260811 04:52:38.390013 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:38 dist-test-slave-njxd krb5kdc[8480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:38.512674 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38467
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:38.621871 8494 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:38.622128 8494 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:38.622169 8494 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:38.626156 8494 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:38.626219 8494 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:38.626238 8494 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:38.626255 8494 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:38.626319 8494 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:38.631510 8494 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38467
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8494
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:38.632563 8494 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:38.633647 8494 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:38.642045 8500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:38.642102 8494 server_base.cc:1034] running on GCE node
W20260811 04:52:38.642274 8503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:38.642045 8499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:38.642904 8494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:38.643947 8494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:38.645113 8494 hybrid_clock.cc:648] HybridClock initialized: now 1786423958645095 us; error 31 us; skew 500 ppm
Aug 11 04:52:38 dist-test-slave-njxd krb5kdc[8480](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423958, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:38.647969 8494 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:38.648850 8494 webserver.cc:460] Webserver started at http://127.0.0.1:45397/ using document root <none> and password file <none>
I20260811 04:52:38.649411 8494 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:38.649506 8494 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:38.649781 8494 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:38.651897 8494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "0d043b58d5014e8b80db540dab0b544e"
format_stamp: "Formatted at 2026-08-11 04:52:38 on dist-test-slave-njxd"
server_key: "865bbc54146097ef67f601a8bb17b51c"
server_key_iv: "25a64b92b2e3621e29edb55406800b24"
server_key_version: "encryptionkey@0"
I20260811 04:52:38.652506 8494 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "0d043b58d5014e8b80db540dab0b544e"
format_stamp: "Formatted at 2026-08-11 04:52:38 on dist-test-slave-njxd"
server_key: "865bbc54146097ef67f601a8bb17b51c"
server_key_iv: "25a64b92b2e3621e29edb55406800b24"
server_key_version: "encryptionkey@0"
I20260811 04:52:38.656400 8494 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 04:52:38.658816 8510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:38.660022 8494 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:38.660161 8494 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "0d043b58d5014e8b80db540dab0b544e"
format_stamp: "Formatted at 2026-08-11 04:52:38 on dist-test-slave-njxd"
server_key: "865bbc54146097ef67f601a8bb17b51c"
server_key_iv: "25a64b92b2e3621e29edb55406800b24"
server_key_version: "encryptionkey@0"
I20260811 04:52:38.660274 8494 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:38.664827 8494 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:38.667989 8494 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:38.668188 8494 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:38.675397 8494 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38467
I20260811 04:52:38.675431 8568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38467 every 8 connection(s)
I20260811 04:52:38.676326 8494 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:38.679119 8569 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:38.679487 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8494
I20260811 04:52:38.679641 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:38.680004 18161 external_mini_cluster.cc:1428] Setting key ac71967e3e4abdc54ddc2b82913d9f36
I20260811 04:52:38.685264 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:38.681430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36685 (local address 127.0.0.1:38467)
0811 04:52:38.681966 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:38.681980 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:38.682016 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:52:38.682694 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:38.682711 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:38.682982 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:38.683327 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:38.684114 (+ 787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:38.684118 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:38.684130 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:38.684147 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:38.684199 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:38.684217 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:38.684377 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:38.684445 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 04:52:38.684615 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":193,"threads_started":1}
I20260811 04:52:38.686234 8569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e: Bootstrap starting.
I20260811 04:52:38.688233 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:38.688936 8569 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:38.689797 8569 log.cc:824] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:38.692049 8572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:38.690481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39075 (local address 127.0.0.1:38467)
0811 04:52:38.690607 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:38.690611 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:38.690793 (+ 182us) server_negotiation.cc:407] Connection header received
0811 04:52:38.690896 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:38.690898 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:38.690924 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:38.690987 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:38.691663 (+ 676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:38.691665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:38.691667 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:38.691677 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:38.691700 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:38.691710 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:38.691775 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:38.691891 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 04:52:38.691920 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 04:52:38.692103 8569 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e: No bootstrap required, opened a new log
I20260811 04:52:38.695900 8569 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260811 04:52:38.696142 8569 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:38.696237 8569 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d043b58d5014e8b80db540dab0b544e, State: Initialized, Role: FOLLOWER
I20260811 04:52:38.696727 8569 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260811 04:52:38.696899 8569 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:38.696974 8569 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:38.697073 8569 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:38.698038 8569 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260811 04:52:38.698380 8569 leader_election.cc:302] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d043b58d5014e8b80db540dab0b544e; no voters:
I20260811 04:52:38.698685 8569 leader_election.cc:288] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:38.698801 8581 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:38.699034 8581 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [term 1 LEADER]: Becoming Leader. State: Replica: 0d043b58d5014e8b80db540dab0b544e, State: Running, Role: LEADER
I20260811 04:52:38.699597 8581 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } }
I20260811 04:52:38.700088 8569 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:38.701370 8582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d043b58d5014e8b80db540dab0b544e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } } }
I20260811 04:52:38.701436 8583 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d043b58d5014e8b80db540dab0b544e. Latest consensus state: current_term: 1 leader_uuid: "0d043b58d5014e8b80db540dab0b544e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d043b58d5014e8b80db540dab0b544e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38467 } } }
I20260811 04:52:38.701499 8582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:38.701560 8583 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:38.701915 8592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:38.704506 8592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:38.709959 8592 catalog_manager.cc:1347] Generated new cluster ID: db3072d215104615a0e28c4fdd5b8ab0
I20260811 04:52:38.710033 8592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:38.732542 8592 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:38.732893 8592 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:38.744371 8592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d043b58d5014e8b80db540dab0b544e: Generated new TSK 0
I20260811 04:52:38.745203 8592 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:38.753232 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8494
2026-08-11T04:52:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:38 dist-test-slave-njxd krb5kdc[8603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:38 dist-test-slave-njxd krb5kdc[8603](info): set up 2 sockets
Aug 11 04:52:38 dist-test-slave-njxd krb5kdc[8603](info): commencing operation
krb5kdc: starting...
W20260811 04:52:39.857738 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.001s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:39 dist-test-slave-njxd krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:39.988772 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:40.104104 8618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:40.104460 8618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:40.104542 8618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:40.108620 8618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:40.108732 8618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:40.108772 8618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:40.108811 8618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:40.108847 8618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:40.114344 8618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:40.115588 8618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:40.116708 8618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:40.125634 8625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:40.125677 8618 server_base.cc:1034] running on GCE node
W20260811 04:52:40.125696 8626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:40.125638 8628 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:40.126459 8618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:40.127629 8618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:40.128846 8618 hybrid_clock.cc:648] HybridClock initialized: now 1786423960128832 us; error 26 us; skew 500 ppm
Aug 11 04:52:40 dist-test-slave-njxd krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423960, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:40.131783 8618 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:40.132735 8618 webserver.cc:460] Webserver started at http://127.0.0.1:36149/ using document root <none> and password file <none>
I20260811 04:52:40.133329 8618 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:40.133423 8618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:40.133729 8618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:40.136010 8618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "23ef69079336498085cafdea167869de"
format_stamp: "Formatted at 2026-08-11 04:52:40 on dist-test-slave-njxd"
server_key: "00d5b9ae9fe44187a9c8f34548a92fa8"
server_key_iv: "e7484d67cdd53c4824bfb5ac912ee627"
server_key_version: "encryptionkey@0"
I20260811 04:52:40.136605 8618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "23ef69079336498085cafdea167869de"
format_stamp: "Formatted at 2026-08-11 04:52:40 on dist-test-slave-njxd"
server_key: "00d5b9ae9fe44187a9c8f34548a92fa8"
server_key_iv: "e7484d67cdd53c4824bfb5ac912ee627"
server_key_version: "encryptionkey@0"
I20260811 04:52:40.140597 8618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 04:52:40.143210 8636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:40.144534 8618 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:40.144698 8618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "23ef69079336498085cafdea167869de"
format_stamp: "Formatted at 2026-08-11 04:52:40 on dist-test-slave-njxd"
server_key: "00d5b9ae9fe44187a9c8f34548a92fa8"
server_key_iv: "e7484d67cdd53c4824bfb5ac912ee627"
server_key_version: "encryptionkey@0"
I20260811 04:52:40.144829 8618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:40.169298 8618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:40.172312 8618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:40.172542 8618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:40.180084 8618 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38569
I20260811 04:52:40.180112 8694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38569 every 8 connection(s)
I20260811 04:52:40.181071 8618 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:40.183861 8695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:40.186138 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8618
I20260811 04:52:40.186301 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:40.186581 18161 external_mini_cluster.cc:1428] Setting key 2aff9384b5ce6bad83e2d96f62830582
I20260811 04:52:40.190351 8695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de: Bootstrap starting.
I20260811 04:52:40.193089 8695 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:40.194016 8695 log.cc:824] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:40.196182 8695 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de: No bootstrap required, opened a new log
Aug 11 04:52:40 dist-test-slave-njxd krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423959, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 04:52:40.200548 8695 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } }
I20260811 04:52:40.200871 8695 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:40.200963 8695 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23ef69079336498085cafdea167869de, State: Initialized, Role: FOLLOWER
I20260811 04:52:40.201431 8695 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } }
I20260811 04:52:40.201581 8695 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:40.201678 8695 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:40.201783 8695 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:40.202845 8695 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } }
I20260811 04:52:40.203094 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:40.188063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38077 (local address 127.0.0.1:38569)
0811 04:52:40.188512 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:40.188531 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:40.188576 (+ 45us) server_negotiation.cc:407] Connection header received
0811 04:52:40.189432 (+ 856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:40.189457 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:40.189955 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:40.190351 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:40.191144 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:40.192701 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:40.193754 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:40.194484 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:40.194619 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:40.197395 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:40.197401 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:40.197418 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:40.197451 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:40.200055 (+ 2604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:40.200482 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:40.200487 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:40.200493 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:40.200645 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:40.200921 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:40.200926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:40.200928 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:40.201441 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:40.201683 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:40.201978 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 04:52:40.202285 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":120,"threads_started":1}
I20260811 04:52:40.203245 8695 leader_election.cc:302] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23ef69079336498085cafdea167869de; no voters:
I20260811 04:52:40.203601 8695 leader_election.cc:288] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:40.203732 8702 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:40.204002 8702 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [term 1 LEADER]: Becoming Leader. State: Replica: 23ef69079336498085cafdea167869de, State: Running, Role: LEADER
I20260811 04:52:40.204365 8702 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } }
I20260811 04:52:40.204887 8695 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:40.206207 8704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23ef69079336498085cafdea167869de. Latest consensus state: current_term: 1 leader_uuid: "23ef69079336498085cafdea167869de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } } }
I20260811 04:52:40.206360 8704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:40.207213 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:40.206207 8703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23ef69079336498085cafdea167869de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23ef69079336498085cafdea167869de" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38569 } } }
I20260811 04:52:40.206854 8711 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:40.207722 8703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:40.211138 8711 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:40.218060 8711 catalog_manager.cc:1347] Generated new cluster ID: d58a5cf7d21641b7a735efb968c3fab8
I20260811 04:52:40.218202 8711 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:40.219116 8698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:40.209491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60157 (local address 127.0.0.1:38569)
0811 04:52:40.209618 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:40.209622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:40.209881 (+ 259us) server_negotiation.cc:407] Connection header received
0811 04:52:40.210002 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:40.210005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:40.210055 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:40.210144 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:40.211015 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:40.211815 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:40.213045 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:40.213409 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:40.213485 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:40.215360 (+ 1875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:40.215363 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:40.215366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:40.215392 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:40.216956 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:40.217395 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:40.217398 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:40.217400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:40.217487 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:40.217839 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:40.217843 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:40.217847 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:40.218083 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:40.218212 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:40.218853 (+ 641us) server_negotiation.cc:299] Negotiation successful
0811 04:52:40.218971 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 04:52:40.232156 8711 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:40.233096 8711 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:40.242805 8711 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23ef69079336498085cafdea167869de: Generated new TSK 0
I20260811 04:52:40.243556 8711 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:40.248831 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8618
2026-08-11T04:52:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1496 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:40 dist-test-slave-njxd krb5kdc[8730](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:40 dist-test-slave-njxd krb5kdc[8730](info): set up 2 sockets
Aug 11 04:52:40 dist-test-slave-njxd krb5kdc[8730](info): commencing operation
krb5kdc: starting...
W20260811 04:52:41.343169 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:41 dist-test-slave-njxd krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423961, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:41.469129 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42441
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45151
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:41.580597 8743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:41.580894 8743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:41.580971 8743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:41.584889 8743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:41.584991 8743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:41.585031 8743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:41.585069 8743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:41.585099 8743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:41.590341 8743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45151
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:41.591455 8743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:41.592502 8743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:41.601070 8752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:41.601066 8749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:41.601091 8748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:41.601291 8743 server_base.cc:1034] running on GCE node
I20260811 04:52:41.602015 8743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:41.603097 8743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:41.604264 8743 hybrid_clock.cc:648] HybridClock initialized: now 1786423961604248 us; error 26 us; skew 500 ppm
Aug 11 04:52:41 dist-test-slave-njxd krb5kdc[8730](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423961, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:41.607221 8743 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:41.608108 8743 webserver.cc:460] Webserver started at http://127.0.0.1:44313/ using document root <none> and password file <none>
I20260811 04:52:41.608690 8743 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:41.608784 8743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:41.609023 8743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:41.611143 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "94225bb534ff4e77a509197b6000ec42"
format_stamp: "Formatted at 2026-08-11 04:52:41 on dist-test-slave-njxd"
server_key: "6fb04c476e573730a469923a58aef6c6"
server_key_iv: "4a00e7d03397f64729b1d77220d416e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:41.611732 8743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "94225bb534ff4e77a509197b6000ec42"
format_stamp: "Formatted at 2026-08-11 04:52:41 on dist-test-slave-njxd"
server_key: "6fb04c476e573730a469923a58aef6c6"
server_key_iv: "4a00e7d03397f64729b1d77220d416e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:41.615530 8743 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:52:41.617937 8759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:41.619135 8743 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:52:41.619277 8743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "94225bb534ff4e77a509197b6000ec42"
format_stamp: "Formatted at 2026-08-11 04:52:41 on dist-test-slave-njxd"
server_key: "6fb04c476e573730a469923a58aef6c6"
server_key_iv: "4a00e7d03397f64729b1d77220d416e9"
server_key_version: "encryptionkey@0"
I20260811 04:52:41.619390 8743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:41.640342 8743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:41.643417 8743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:41.643646 8743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:41.651094 8743 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42441
I20260811 04:52:41.651111 8816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42441 every 8 connection(s)
I20260811 04:52:41.652136 8743 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:41.655045 8817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:41.655408 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8743
I20260811 04:52:41.655580 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:41.655884 18161 external_mini_cluster.cc:1428] Setting key 459a666d447d1d1a8e43b8107284dcec
I20260811 04:52:41.661988 8817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42: Bootstrap starting.
I20260811 04:52:41.664585 8817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:41.664888 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:41.657247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59509 (local address 127.0.0.1:42441)
0811 04:52:41.657699 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:41.657715 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:41.657750 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:41.658413 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:41.658430 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:41.658771 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:41.659048 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:41.659419 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:41.660384 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:41.661668 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:41.662148 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:41.662291 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:41.663140 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:41.663145 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:41.663160 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:41.663535 (+ 375us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:41.663589 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:41.663612 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:41.663702 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:41.663855 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 04:52:41.664090 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":141,"threads_started":1}
I20260811 04:52:41.665519 8817 log.cc:824] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:41.667598 8817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42: No bootstrap required, opened a new log
I20260811 04:52:41.667783 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:41.671484 8817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } }
I20260811 04:52:41.671727 8817 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:41.671818 8817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94225bb534ff4e77a509197b6000ec42, State: Initialized, Role: FOLLOWER
I20260811 04:52:41.672272 8817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } }
I20260811 04:52:41.672479 8817 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:41.672554 8817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:41.672931 8817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:41.673530 8821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:41.669753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59713 (local address 127.0.0.1:42441)
0811 04:52:41.669880 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:41.669884 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:41.670014 (+ 130us) server_negotiation.cc:407] Connection header received
0811 04:52:41.670173 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:41.670176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:41.670222 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:41.670300 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:41.670556 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:41.671061 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:41.671872 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:41.672212 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:41.672313 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:41.673109 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:41.673113 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:41.673116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:41.673127 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:41.673166 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:41.673177 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:41.673257 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:41.673353 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 04:52:41.673402 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 04:52:41.674045 8817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } }
I20260811 04:52:41.674381 8817 leader_election.cc:302] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94225bb534ff4e77a509197b6000ec42; no voters:
I20260811 04:52:41.674778 8817 leader_election.cc:288] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:41.674858 8828 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:41.675071 8828 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [term 1 LEADER]: Becoming Leader. State: Replica: 94225bb534ff4e77a509197b6000ec42, State: Running, Role: LEADER
I20260811 04:52:41.675364 8828 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } }
I20260811 04:52:41.676087 8817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:41.676978 8829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94225bb534ff4e77a509197b6000ec42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } } }
I20260811 04:52:41.677166 8829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:41.677597 8837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:41.677637 8830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94225bb534ff4e77a509197b6000ec42. Latest consensus state: current_term: 1 leader_uuid: "94225bb534ff4e77a509197b6000ec42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94225bb534ff4e77a509197b6000ec42" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42441 } } }
I20260811 04:52:41.677822 8830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:41.680682 8837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:41.686043 8837 catalog_manager.cc:1347] Generated new cluster ID: 75fd727859e54e0794df5ea2a7541a24
I20260811 04:52:41.686111 8837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:41.697551 8837 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:41.698523 8837 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:41.711282 8837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94225bb534ff4e77a509197b6000ec42: Generated new TSK 0
I20260811 04:52:41.712148 8837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:41.723546 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8743
2026-08-11T04:52:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1473 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:41 dist-test-slave-njxd krb5kdc[8853](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:41 dist-test-slave-njxd krb5kdc[8853](info): set up 2 sockets
Aug 11 04:52:41 dist-test-slave-njxd krb5kdc[8853](info): commencing operation
krb5kdc: starting...
W20260811 04:52:42.813875 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:42 dist-test-slave-njxd krb5kdc[8853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423962, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:42.941233 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43271
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43271
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:43.052914 8866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:43.053256 8866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:43.053352 8866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:43.057821 8866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:43.057904 8866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:43.057940 8866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:43.057996 8866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:43.058034 8866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:43.063441 8866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:43.064602 8866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:43.065852 8866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:43.077009 8874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:43.077131 8871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:43.077414 8872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:43.078145 8866 server_base.cc:1034] running on GCE node
I20260811 04:52:43.078954 8866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:43.080188 8866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:43.081359 8866 hybrid_clock.cc:648] HybridClock initialized: now 1786423963081329 us; error 39 us; skew 500 ppm
Aug 11 04:52:43 dist-test-slave-njxd krb5kdc[8853](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423963, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:43.084180 8866 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:43.085088 8866 webserver.cc:460] Webserver started at http://127.0.0.1:34781/ using document root <none> and password file <none>
I20260811 04:52:43.085729 8866 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:43.085824 8866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:43.086057 8866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:43.088150 8866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "86a69e69b03a41ffbc2ad0c681a20891"
format_stamp: "Formatted at 2026-08-11 04:52:43 on dist-test-slave-njxd"
server_key: "efdfaadcd2d3a87b23cdc7b69a3ecf11"
server_key_iv: "ed168d28f46db9481045219f0f8c5f40"
server_key_version: "encryptionkey@0"
I20260811 04:52:43.088737 8866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "86a69e69b03a41ffbc2ad0c681a20891"
format_stamp: "Formatted at 2026-08-11 04:52:43 on dist-test-slave-njxd"
server_key: "efdfaadcd2d3a87b23cdc7b69a3ecf11"
server_key_iv: "ed168d28f46db9481045219f0f8c5f40"
server_key_version: "encryptionkey@0"
I20260811 04:52:43.092525 8866 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 04:52:43.094903 8882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:43.096097 8866 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:43.096237 8866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "86a69e69b03a41ffbc2ad0c681a20891"
format_stamp: "Formatted at 2026-08-11 04:52:43 on dist-test-slave-njxd"
server_key: "efdfaadcd2d3a87b23cdc7b69a3ecf11"
server_key_iv: "ed168d28f46db9481045219f0f8c5f40"
server_key_version: "encryptionkey@0"
I20260811 04:52:43.096344 8866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:43.101032 8866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:43.103953 8866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:43.104161 8866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:43.111581 8866 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43271
I20260811 04:52:43.111596 8939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43271 every 8 connection(s)
I20260811 04:52:43.112515 8866 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:43.115374 8940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:43.117717 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8866
I20260811 04:52:43.117871 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:43.118182 18161 external_mini_cluster.cc:1428] Setting key c5f580f6f8f9825109e7ed9cb014e53b
I20260811 04:52:43.121276 8940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891: Bootstrap starting.
I20260811 04:52:43.123214 8943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:43.119509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46963 (local address 127.0.0.1:43271)
0811 04:52:43.119923 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:43.119938 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:43.119973 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:43.120585 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:43.120601 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:43.120886 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:43.121160 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:43.122008 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:43.122012 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:43.122024 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:43.122032 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:43.122081 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:43.122099 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:43.122208 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:43.122334 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 04:52:43.122507 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":141,"threads_started":1}
I20260811 04:52:43.124119 8940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:43.124868 8940 log.cc:824] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:43.126220 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:43.127017 8940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891: No bootstrap required, opened a new log
I20260811 04:52:43.129873 8943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:43.128283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57051 (local address 127.0.0.1:43271)
0811 04:52:43.128403 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:43.128408 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:43.128522 (+ 114us) server_negotiation.cc:407] Connection header received
0811 04:52:43.128594 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:43.128596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:43.128628 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:43.128707 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:43.129453 (+ 746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:43.129455 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:43.129457 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:43.129467 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:43.129490 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:43.129500 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:43.129565 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:43.129702 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 04:52:43.129733 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:52:43.131390 8940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260811 04:52:43.131618 8940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:43.131683 8940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a69e69b03a41ffbc2ad0c681a20891, State: Initialized, Role: FOLLOWER
I20260811 04:52:43.132067 8940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260811 04:52:43.132215 8940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:43.132282 8940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:43.132387 8940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:43.133255 8940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260811 04:52:43.133534 8940 leader_election.cc:302] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86a69e69b03a41ffbc2ad0c681a20891; no voters:
I20260811 04:52:43.133848 8940 leader_election.cc:288] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:43.133957 8950 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:43.134202 8950 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [term 1 LEADER]: Becoming Leader. State: Replica: 86a69e69b03a41ffbc2ad0c681a20891, State: Running, Role: LEADER
I20260811 04:52:43.134533 8950 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } }
I20260811 04:52:43.135107 8940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:43.136303 8952 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86a69e69b03a41ffbc2ad0c681a20891. Latest consensus state: current_term: 1 leader_uuid: "86a69e69b03a41ffbc2ad0c681a20891" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } } }
I20260811 04:52:43.136451 8952 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:43.136858 8960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:43.136831 8951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86a69e69b03a41ffbc2ad0c681a20891" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a69e69b03a41ffbc2ad0c681a20891" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43271 } } }
I20260811 04:52:43.137462 8951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:43.139993 8960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:43.145648 8960 catalog_manager.cc:1347] Generated new cluster ID: 7aa253bd3b0c48a89332a9e97a6f6f91
I20260811 04:52:43.145730 8960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:43.155279 8960 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:43.155618 8960 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:43.164058 8960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86a69e69b03a41ffbc2ad0c681a20891: Generated new TSK 0
I20260811 04:52:43.164793 8960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:43.179308 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8866
2026-08-11T04:52:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:43 dist-test-slave-njxd krb5kdc[8974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:43 dist-test-slave-njxd krb5kdc[8974](info): set up 2 sockets
Aug 11 04:52:43 dist-test-slave-njxd krb5kdc[8974](info): commencing operation
krb5kdc: starting...
W20260811 04:52:44.267373 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.065s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[8974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423964, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:44.397229 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37393
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:44.509888 8987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:44.510185 8987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:44.510259 8987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:44.514247 8987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:44.514329 8987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:44.514369 8987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:44.514428 8987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:44.514467 8987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:44.519577 8987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:44.520624 8987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:44.521662 8987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:44.530076 8995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:44.530066 8994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:44.530189 8987 server_base.cc:1034] running on GCE node
W20260811 04:52:44.530089 8998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:44.530892 8987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:44.531957 8987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:44.533157 8987 hybrid_clock.cc:648] HybridClock initialized: now 1786423964533140 us; error 23 us; skew 500 ppm
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[8974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423964, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:44.539837 8987 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:44.540743 8987 webserver.cc:460] Webserver started at http://127.0.0.1:45765/ using document root <none> and password file <none>
I20260811 04:52:44.541328 8987 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:44.541419 8987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:44.541723 8987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:44.543848 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "a5c0e7bae3e542cab47d9be00799ad67"
format_stamp: "Formatted at 2026-08-11 04:52:44 on dist-test-slave-njxd"
server_key: "1b0596e480a40af049d78741f0e219fa"
server_key_iv: "ace6d3c073f587d477d9cfd59d5f2ae1"
server_key_version: "encryptionkey@0"
I20260811 04:52:44.544420 8987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "a5c0e7bae3e542cab47d9be00799ad67"
format_stamp: "Formatted at 2026-08-11 04:52:44 on dist-test-slave-njxd"
server_key: "1b0596e480a40af049d78741f0e219fa"
server_key_iv: "ace6d3c073f587d477d9cfd59d5f2ae1"
server_key_version: "encryptionkey@0"
I20260811 04:52:44.548065 8987 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:44.550462 9007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:44.551673 8987 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:44.551812 8987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "a5c0e7bae3e542cab47d9be00799ad67"
format_stamp: "Formatted at 2026-08-11 04:52:44 on dist-test-slave-njxd"
server_key: "1b0596e480a40af049d78741f0e219fa"
server_key_iv: "ace6d3c073f587d477d9cfd59d5f2ae1"
server_key_version: "encryptionkey@0"
I20260811 04:52:44.551923 8987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:44.565073 8987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:44.568156 8987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:44.568370 8987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:44.575799 8987 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37393
I20260811 04:52:44.575829 9063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37393 every 8 connection(s)
I20260811 04:52:44.576767 8987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:44.579630 9064 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:44.584043 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 8987
I20260811 04:52:44.584223 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:44.584497 18161 external_mini_cluster.cc:1428] Setting key 312fbcceaa8e20da63fdad6bdac833d0
I20260811 04:52:44.585747 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: Bootstrap starting.
I20260811 04:52:44.588475 9064 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:44.589339 9064 log.cc:824] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:44.591290 9064 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: No bootstrap required, opened a new log
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[8974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423964, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 04:52:44.595379 9064 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } }
I20260811 04:52:44.595587 9064 raft_consensus.cc:374] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:44.595629 9064 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5c0e7bae3e542cab47d9be00799ad67, State: Initialized, Role: FOLLOWER
I20260811 04:52:44.596163 9064 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } }
I20260811 04:52:44.596314 9064 raft_consensus.cc:388] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:44.596405 9064 raft_consensus.cc:482] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:44.596503 9064 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:44.597455 9064 raft_consensus.cc:504] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } }
I20260811 04:52:44.597805 9064 leader_election.cc:302] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a5c0e7bae3e542cab47d9be00799ad67; no voters:
I20260811 04:52:44.598168 9064 leader_election.cc:288] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:44.598250 9069 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:44.598480 9069 raft_consensus.cc:686] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [term 1 LEADER]: Becoming Leader. State: Replica: a5c0e7bae3e542cab47d9be00799ad67, State: Running, Role: LEADER
I20260811 04:52:44.598874 9069 consensus_queue.cc:237] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } }
I20260811 04:52:44.599547 9064 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:44.600538 9071 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a5c0e7bae3e542cab47d9be00799ad67. Latest consensus state: current_term: 1 leader_uuid: "a5c0e7bae3e542cab47d9be00799ad67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } } }
I20260811 04:52:44.600662 9071 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:44.600785 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:44.586015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:57701 (local address 127.0.0.1:37393)
0811 04:52:44.586423 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:44.586441 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:44.586483 (+ 42us) server_negotiation.cc:407] Connection header received
0811 04:52:44.587375 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:44.587397 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:44.587841 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:44.588206 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:44.588956 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:44.590303 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:44.591245 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:44.591908 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:44.592070 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:44.594960 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:44.594965 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:44.594979 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:44.595005 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:44.597018 (+ 2013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:44.597645 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:44.597652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:44.597658 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:44.597781 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:44.598170 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:44.598174 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:44.598175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:44.598759 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:44.598986 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:44.599544 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 04:52:44.599787 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":108,"threads_started":1}
I20260811 04:52:44.601259 9070 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a5c0e7bae3e542cab47d9be00799ad67" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a5c0e7bae3e542cab47d9be00799ad67" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37393 } } }
I20260811 04:52:44.601410 9070 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:44.604053 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 04:52:44.605129 9086 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:52:44.605208 9086 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:52:44.605276 9080 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:44.606204 9080 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:44.611704 9080 catalog_manager.cc:1347] Generated new cluster ID: 46981bf0150043b1bf125d3f653479ec
I20260811 04:52:44.611824 9080 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:44.616402 9067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:44.606345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:43405 (local address 127.0.0.1:37393)
0811 04:52:44.607675 (+ 1330us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:44.607679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:44.608005 (+ 326us) server_negotiation.cc:407] Connection header received
0811 04:52:44.608185 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:44.608189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:44.608236 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:44.608321 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:44.608954 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:44.609459 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:44.610575 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:44.610814 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:44.610921 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:44.612583 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:44.612587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:44.612590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:44.612625 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:44.614330 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:44.614871 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:44.614875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:44.614877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:44.614974 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:44.615343 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:44.615346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:44.615348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:44.615564 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:44.615714 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:44.615984 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 04:52:44.616255 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1264}
I20260811 04:52:44.633643 9080 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:44.634573 9080 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:44.646349 9080 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a5c0e7bae3e542cab47d9be00799ad67: Generated new TSK 0
I20260811 04:52:44.647217 9080 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:44.650728 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 8987
W20260811 04:52:44.659430 8971 connection.cc:535] client connection to 127.0.0.1:37393 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37393): Connection reset by peer (error 104)
2026-08-11T04:52:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1471 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[9097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[9097](info): set up 2 sockets
Aug 11 04:52:44 dist-test-slave-njxd krb5kdc[9097](info): commencing operation
krb5kdc: starting...
W20260811 04:52:45.754776 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:45 dist-test-slave-njxd krb5kdc[9097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423965, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:45.901254 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45985
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:46.016348 9110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:46.016615 9110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:46.016685 9110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:46.020788 9110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:46.020856 9110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:46.020876 9110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:46.020893 9110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:46.020908 9110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:46.026638 9110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:46.027777 9110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:46.028867 9110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:46.037484 9116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:46.037492 9118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:46.037484 9115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:46.037791 9110 server_base.cc:1034] running on GCE node
I20260811 04:52:46.038520 9110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:46.039645 9110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:46.040807 9110 hybrid_clock.cc:648] HybridClock initialized: now 1786423966040781 us; error 42 us; skew 500 ppm
Aug 11 04:52:46 dist-test-slave-njxd krb5kdc[9097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423966, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:46.043553 9110 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:46.044487 9110 webserver.cc:460] Webserver started at http://127.0.0.1:39967/ using document root <none> and password file <none>
I20260811 04:52:46.045053 9110 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:46.045143 9110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:46.045372 9110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:46.047497 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "33f169854b464b41b73e9e50cb944925"
format_stamp: "Formatted at 2026-08-11 04:52:46 on dist-test-slave-njxd"
server_key: "0f36030d696b0733a561149e37ea5df2"
server_key_iv: "029f2f3e703ac60ce555718e9f550d50"
server_key_version: "encryptionkey@0"
I20260811 04:52:46.048141 9110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "33f169854b464b41b73e9e50cb944925"
format_stamp: "Formatted at 2026-08-11 04:52:46 on dist-test-slave-njxd"
server_key: "0f36030d696b0733a561149e37ea5df2"
server_key_iv: "029f2f3e703ac60ce555718e9f550d50"
server_key_version: "encryptionkey@0"
I20260811 04:52:46.051813 9110 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:46.054224 9125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:46.055433 9110 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:46.055569 9110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "33f169854b464b41b73e9e50cb944925"
format_stamp: "Formatted at 2026-08-11 04:52:46 on dist-test-slave-njxd"
server_key: "0f36030d696b0733a561149e37ea5df2"
server_key_iv: "029f2f3e703ac60ce555718e9f550d50"
server_key_version: "encryptionkey@0"
I20260811 04:52:46.055706 9110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:46.068778 9110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:46.071913 9110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:46.072134 9110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:46.079744 9110 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45985
I20260811 04:52:46.079772 9188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45985 every 8 connection(s)
I20260811 04:52:46.080719 9110 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:46.083551 9189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:46.088831 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9110
I20260811 04:52:46.088984 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:46.089253 18161 external_mini_cluster.cc:1428] Setting key 251c292743412d198f4b3eb41dc077d8
I20260811 04:52:46.089231 9189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925: Bootstrap starting.
I20260811 04:52:46.092015 9189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:46.092913 9189 log.cc:824] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:46.095144 9189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925: No bootstrap required, opened a new log
I20260811 04:52:46.099589 9192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:46.090619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:46289 (local address 127.0.0.1:45985)
0811 04:52:46.091070 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:46.091090 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:46.091132 (+ 42us) server_negotiation.cc:407] Connection header received
0811 04:52:46.091993 (+ 861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:46.092019 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:46.092493 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:46.092868 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:46.093317 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:46.094765 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:46.095737 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:46.096416 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:46.096594 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:46.097410 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:46.097417 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:46.097433 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:46.098041 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:46.098123 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:46.098163 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:46.098327 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:46.098475 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 04:52:46.098613 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":116,"threads_started":1}
I20260811 04:52:46.099560 9189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } }
I20260811 04:52:46.099854 9189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:46.099916 9189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33f169854b464b41b73e9e50cb944925, State: Initialized, Role: FOLLOWER
I20260811 04:52:46.100294 9189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } }
I20260811 04:52:46.100397 9189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:46.100435 9189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:46.100493 9189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:46.101425 9189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } }
I20260811 04:52:46.101837 9189 leader_election.cc:302] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33f169854b464b41b73e9e50cb944925; no voters:
I20260811 04:52:46.102222 9189 leader_election.cc:288] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:46.102327 9194 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:46.102604 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:46.102592 9194 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [term 1 LEADER]: Becoming Leader. State: Replica: 33f169854b464b41b73e9e50cb944925, State: Running, Role: LEADER
I20260811 04:52:46.102902 9194 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } }
I20260811 04:52:46.103545 9189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:46.104441 9195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33f169854b464b41b73e9e50cb944925" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } } }
I20260811 04:52:46.104559 9195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:46.104919 9196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33f169854b464b41b73e9e50cb944925. Latest consensus state: current_term: 1 leader_uuid: "33f169854b464b41b73e9e50cb944925" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33f169854b464b41b73e9e50cb944925" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45985 } } }
I20260811 04:52:46.105051 9196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:46.104961 9208 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:46.108764 9208 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:46.110975 9192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:46.105493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:43095 (local address 127.0.0.1:45985)
0811 04:52:46.105620 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:46.105625 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:46.106724 (+ 1099us) server_negotiation.cc:407] Connection header received
0811 04:52:46.106814 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:46.106817 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:46.106870 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:46.106963 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:46.107221 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:46.107973 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:46.109099 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:46.109431 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:46.109534 (+ 103us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:46.110476 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:46.110480 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:46.110483 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:46.110495 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:46.110523 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:46.110535 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:46.110629 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:46.110800 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 04:52:46.110834 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 04:52:46.114382 9208 catalog_manager.cc:1347] Generated new cluster ID: f553aeda8d6d46c2b70c9fa8cd8a8c3c
I20260811 04:52:46.114444 9208 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:46.126004 9208 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:46.127285 9208 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:46.144295 9208 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33f169854b464b41b73e9e50cb944925: Generated new TSK 0
I20260811 04:52:46.145191 9208 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:46.154723 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9110
W20260811 04:52:46.162925 9095 connection.cc:535] client connection to 127.0.0.1:45985 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45985): Connection reset by peer (error 104)
2026-08-11T04:52:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:46 dist-test-slave-njxd krb5kdc[9222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:46 dist-test-slave-njxd krb5kdc[9222](info): set up 2 sockets
Aug 11 04:52:46 dist-test-slave-njxd krb5kdc[9222](info): commencing operation
krb5kdc: starting...
W20260811 04:52:47.246584 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:47 dist-test-slave-njxd krb5kdc[9222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423967, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:47.372996 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46221
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35805
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:47.484375 9235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:47.484696 9235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:47.484777 9235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:47.488909 9235 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:47.489009 9235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:47.489048 9235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:47.489109 9235 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:47.489151 9235 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:47.494800 9235 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35805
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:47.495950 9235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:47.497030 9235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:47.506098 9242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:47.506122 9240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:47.506098 9244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:47.506193 9235 server_base.cc:1034] running on GCE node
I20260811 04:52:47.506963 9235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:47.508069 9235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:47.509260 9235 hybrid_clock.cc:648] HybridClock initialized: now 1786423967509231 us; error 40 us; skew 500 ppm
Aug 11 04:52:47 dist-test-slave-njxd krb5kdc[9222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423967, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:47.512068 9235 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:47.512950 9235 webserver.cc:460] Webserver started at http://127.0.0.1:36673/ using document root <none> and password file <none>
I20260811 04:52:47.513532 9235 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:47.513655 9235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:47.513898 9235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:47.515970 9235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "33bb9cfaf7bb4f48b183b860eb38dcba"
format_stamp: "Formatted at 2026-08-11 04:52:47 on dist-test-slave-njxd"
server_key: "e7aea34fd03e74db57cfdf0012f0dbf7"
server_key_iv: "6471ac88d13bae03ea9f06ef3cb68ff1"
server_key_version: "encryptionkey@0"
I20260811 04:52:47.516531 9235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "33bb9cfaf7bb4f48b183b860eb38dcba"
format_stamp: "Formatted at 2026-08-11 04:52:47 on dist-test-slave-njxd"
server_key: "e7aea34fd03e74db57cfdf0012f0dbf7"
server_key_iv: "6471ac88d13bae03ea9f06ef3cb68ff1"
server_key_version: "encryptionkey@0"
I20260811 04:52:47.520344 9235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.005s
I20260811 04:52:47.522696 9251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:47.523945 9235 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:47.524052 9235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "33bb9cfaf7bb4f48b183b860eb38dcba"
format_stamp: "Formatted at 2026-08-11 04:52:47 on dist-test-slave-njxd"
server_key: "e7aea34fd03e74db57cfdf0012f0dbf7"
server_key_iv: "6471ac88d13bae03ea9f06ef3cb68ff1"
server_key_version: "encryptionkey@0"
I20260811 04:52:47.524142 9235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:47.528528 9235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:47.531405 9235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:47.531555 9235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:47.538571 9235 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46221
I20260811 04:52:47.538633 9307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46221 every 8 connection(s)
I20260811 04:52:47.539615 9235 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:47.542419 9308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:47.547992 9308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba: Bootstrap starting.
I20260811 04:52:47.549661 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9235
I20260811 04:52:47.549839 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:47.550107 18161 external_mini_cluster.cc:1428] Setting key cd848965fa145ef17de5f52a38daf1dd
I20260811 04:52:47.550938 9308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:47.551774 9308 log.cc:824] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:47.554051 9308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba: No bootstrap required, opened a new log
I20260811 04:52:47.555456 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:47.551284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:36081 (local address 127.0.0.1:46221)
0811 04:52:47.551791 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:47.551808 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:47.551867 (+ 59us) server_negotiation.cc:407] Connection header received
0811 04:52:47.552561 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:47.552580 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:47.552872 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:47.553167 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:47.554117 (+ 950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:47.554128 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:47.554145 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:47.554161 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:47.554231 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:47.554254 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:47.554350 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:47.554510 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 04:52:47.554701 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":153,"threads_started":1}
I20260811 04:52:47.558359 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:47.558130 9308 raft_consensus.cc:348] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } }
I20260811 04:52:47.558446 9308 raft_consensus.cc:374] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:47.558530 9308 raft_consensus.cc:729] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33bb9cfaf7bb4f48b183b860eb38dcba, State: Initialized, Role: FOLLOWER
I20260811 04:52:47.558945 9308 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } }
I20260811 04:52:47.559093 9308 raft_consensus.cc:388] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:47.559168 9308 raft_consensus.cc:482] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:47.559273 9308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:47.560495 9308 raft_consensus.cc:504] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } }
I20260811 04:52:47.560922 9308 leader_election.cc:302] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 33bb9cfaf7bb4f48b183b860eb38dcba; no voters:
I20260811 04:52:47.561290 9308 leader_election.cc:288] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:47.561381 9321 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:47.561645 9321 raft_consensus.cc:686] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [term 1 LEADER]: Becoming Leader. State: Replica: 33bb9cfaf7bb4f48b183b860eb38dcba, State: Running, Role: LEADER
I20260811 04:52:47.562033 9321 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } }
I20260811 04:52:47.562530 9312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:47.560632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:45207 (local address 127.0.0.1:46221)
0811 04:52:47.560736 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:47.560743 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:47.560982 (+ 239us) server_negotiation.cc:407] Connection header received
0811 04:52:47.561125 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:47.561128 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:47.561171 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:47.561269 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:47.562073 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:47.562076 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:47.562079 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:47.562090 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:47.562118 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:47.562136 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:47.562213 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:47.562373 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 04:52:47.562417 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 04:52:47.562742 9308 sys_catalog.cc:564] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:47.564288 9322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } } }
I20260811 04:52:47.564345 9323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33bb9cfaf7bb4f48b183b860eb38dcba. Latest consensus state: current_term: 1 leader_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "33bb9cfaf7bb4f48b183b860eb38dcba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46221 } } }
I20260811 04:52:47.564445 9322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:47.564464 9323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:47.564811 9335 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:47.567788 9335 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:47.573482 9335 catalog_manager.cc:1347] Generated new cluster ID: a6698a695c9b49df9bb39f5597aeabd6
I20260811 04:52:47.573559 9335 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:47.585857 9335 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:47.586244 9335 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:47.608126 9335 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 33bb9cfaf7bb4f48b183b860eb38dcba: Generated new TSK 0
I20260811 04:52:47.609030 9335 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:47.613319 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9235
2026-08-11T04:52:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1457 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:47 dist-test-slave-njxd krb5kdc[9343](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:47 dist-test-slave-njxd krb5kdc[9343](info): set up 2 sockets
Aug 11 04:52:47 dist-test-slave-njxd krb5kdc[9343](info): commencing operation
krb5kdc: starting...
W20260811 04:52:48.694867 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:48 dist-test-slave-njxd krb5kdc[9343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:48.820451 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41311
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32927
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:48.932010 9359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:48.932314 9359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:48.932403 9359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:48.936416 9359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:48.936509 9359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:48.936547 9359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:48.936607 9359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:48.936642 9359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:48.941774 9359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32927
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41311
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:48.943207 9359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:48.944485 9359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:48.952977 9367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:48.953100 9369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:48.952977 9366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:48.953299 9359 server_base.cc:1034] running on GCE node
I20260811 04:52:48.953903 9359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:48.954996 9359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:48.956189 9359 hybrid_clock.cc:648] HybridClock initialized: now 1786423968956163 us; error 46 us; skew 500 ppm
Aug 11 04:52:48 dist-test-slave-njxd krb5kdc[9343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423968, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:48.959021 9359 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:48.959909 9359 webserver.cc:460] Webserver started at http://127.0.0.1:37821/ using document root <none> and password file <none>
I20260811 04:52:48.960472 9359 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:48.960564 9359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:48.960819 9359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:48.962957 9359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "3e52fecb65db44c8b01c6a1b3a99548e"
format_stamp: "Formatted at 2026-08-11 04:52:48 on dist-test-slave-njxd"
server_key: "a714e7b503d7b330eee85cd8ef2a4821"
server_key_iv: "c3372f8f93eac93a759cf05755dd0663"
server_key_version: "encryptionkey@0"
I20260811 04:52:48.963529 9359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "3e52fecb65db44c8b01c6a1b3a99548e"
format_stamp: "Formatted at 2026-08-11 04:52:48 on dist-test-slave-njxd"
server_key: "a714e7b503d7b330eee85cd8ef2a4821"
server_key_iv: "c3372f8f93eac93a759cf05755dd0663"
server_key_version: "encryptionkey@0"
I20260811 04:52:48.967276 9359 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 04:52:48.969537 9376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:48.970862 9359 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:52:48.971006 9359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "3e52fecb65db44c8b01c6a1b3a99548e"
format_stamp: "Formatted at 2026-08-11 04:52:48 on dist-test-slave-njxd"
server_key: "a714e7b503d7b330eee85cd8ef2a4821"
server_key_iv: "c3372f8f93eac93a759cf05755dd0663"
server_key_version: "encryptionkey@0"
I20260811 04:52:48.971117 9359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:48.983997 9359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:48.986763 9359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:48.986967 9359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:48.994105 9359 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41311
I20260811 04:52:48.994125 9433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41311 every 8 connection(s)
I20260811 04:52:48.995174 9359 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:48.997527 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9359
I20260811 04:52:48.997701 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:48.998040 18161 external_mini_cluster.cc:1428] Setting key 8d3ecd9f29fd991ac4c276f2c500620b
I20260811 04:52:48.998214 9434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:49.005137 9434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e: Bootstrap starting.
Aug 11 04:52:49 dist-test-slave-njxd krb5kdc[9343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 04:52:49.007892 9434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:49.008781 9434 log.cc:824] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:49.010771 9434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e: No bootstrap required, opened a new log
I20260811 04:52:49.012943 9437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:48.999420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:45347 (local address 127.0.0.1:41311)
0811 04:52:48.999837 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:48.999856 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:48.999904 (+ 48us) server_negotiation.cc:407] Connection header received
0811 04:52:49.000860 (+ 956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:49.000880 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:49.001229 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:49.001502 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:49.002500 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:49.003437 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:49.004616 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:49.005063 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:49.005175 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:49.008070 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:49.008075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:49.008088 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:49.008113 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:49.010070 (+ 1957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:49.010601 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:49.010606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:49.010611 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:49.010718 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:49.011105 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:49.011115 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:49.011117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:49.011485 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:49.011707 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:49.012045 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 04:52:49.012264 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":150,"threads_started":1}
I20260811 04:52:49.014443 9434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } }
I20260811 04:52:49.014686 9434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:49.014750 9434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e52fecb65db44c8b01c6a1b3a99548e, State: Initialized, Role: FOLLOWER
I20260811 04:52:49.015228 9434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } }
I20260811 04:52:49.015383 9434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:49.015479 9434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:49.015606 9434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:49.015913 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:49.016702 9434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } }
I20260811 04:52:49.017067 9434 leader_election.cc:302] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e52fecb65db44c8b01c6a1b3a99548e; no voters:
I20260811 04:52:49.017429 9434 leader_election.cc:288] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:49.017550 9442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:49.017843 9442 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [term 1 LEADER]: Becoming Leader. State: Replica: 3e52fecb65db44c8b01c6a1b3a99548e, State: Running, Role: LEADER
I20260811 04:52:49.018173 9442 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } }
I20260811 04:52:49.018812 9434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:49.019894 9445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } } }
I20260811 04:52:49.020018 9445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:49.020251 9445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e52fecb65db44c8b01c6a1b3a99548e. Latest consensus state: current_term: 1 leader_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e52fecb65db44c8b01c6a1b3a99548e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41311 } } }
I20260811 04:52:49.020324 9445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:49.021278 9456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:49.024303 9456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:49.027420 9437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:49.018453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:33673 (local address 127.0.0.1:41311)
0811 04:52:49.018548 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:49.018552 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:49.018586 (+ 34us) server_negotiation.cc:407] Connection header received
0811 04:52:49.018728 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:49.018731 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:49.018773 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:49.018874 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:49.019753 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:49.020607 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:49.021883 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:49.022220 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:49.022318 (+ 98us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:49.023851 (+ 1533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:49.023854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:49.023857 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:49.023881 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:49.025619 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:49.026158 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:49.026161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:49.026163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:49.026252 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:49.026598 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:49.026602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:49.026603 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:49.026773 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:49.026921 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:49.027193 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 04:52:49.027282 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":38}
I20260811 04:52:49.030900 9456 catalog_manager.cc:1347] Generated new cluster ID: 228d91d16b8e4dcda3b49c6555c208be
I20260811 04:52:49.030963 9456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:49.040752 9456 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:49.041575 9456 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:49.056766 9456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e52fecb65db44c8b01c6a1b3a99548e: Generated new TSK 0
I20260811 04:52:49.057503 9456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:49.068372 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9359
W20260811 04:52:49.079638 9341 connection.cc:535] client connection to 127.0.0.1:41311 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41311): Connection reset by peer (error 104)
2026-08-11T04:52:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1458 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:49 dist-test-slave-njxd krb5kdc[9472](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:49 dist-test-slave-njxd krb5kdc[9472](info): set up 2 sockets
Aug 11 04:52:49 dist-test-slave-njxd krb5kdc[9472](info): commencing operation
krb5kdc: starting...
W20260811 04:52:50.157733 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:50 dist-test-slave-njxd krb5kdc[9472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423970, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:50.286255 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:50.396900 9486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:50.397192 9486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:50.397272 9486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:50.401249 9486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:50.401350 9486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:50.401386 9486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:50.401423 9486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:50.401456 9486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:50.406610 9486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:50.407637 9486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:50.408633 9486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:50.416988 9494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:50.416989 9491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:50.417073 9486 server_base.cc:1034] running on GCE node
W20260811 04:52:50.417007 9492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:50.417873 9486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:50.418941 9486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:50.420130 9486 hybrid_clock.cc:648] HybridClock initialized: now 1786423970420116 us; error 33 us; skew 500 ppm
Aug 11 04:52:50 dist-test-slave-njxd krb5kdc[9472](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423970, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:50.429951 9486 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:50.430883 9486 webserver.cc:460] Webserver started at http://127.0.0.1:42151/ using document root <none> and password file <none>
I20260811 04:52:50.431434 9486 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:50.431527 9486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:50.431766 9486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:50.433869 9486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "9c9e41c66f6f40aea850503a2e51f7b4"
format_stamp: "Formatted at 2026-08-11 04:52:50 on dist-test-slave-njxd"
server_key: "79256a0e255714ee42dd5f29f7c4f4a1"
server_key_iv: "e5a97669d0a2938103c20dff64287b02"
server_key_version: "encryptionkey@0"
I20260811 04:52:50.434448 9486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "9c9e41c66f6f40aea850503a2e51f7b4"
format_stamp: "Formatted at 2026-08-11 04:52:50 on dist-test-slave-njxd"
server_key: "79256a0e255714ee42dd5f29f7c4f4a1"
server_key_iv: "e5a97669d0a2938103c20dff64287b02"
server_key_version: "encryptionkey@0"
I20260811 04:52:50.438165 9486 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:50.440542 9502 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:50.441738 9486 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:50.441883 9486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "9c9e41c66f6f40aea850503a2e51f7b4"
format_stamp: "Formatted at 2026-08-11 04:52:50 on dist-test-slave-njxd"
server_key: "79256a0e255714ee42dd5f29f7c4f4a1"
server_key_iv: "e5a97669d0a2938103c20dff64287b02"
server_key_version: "encryptionkey@0"
I20260811 04:52:50.441998 9486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:50.471613 9486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:50.474841 9486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:50.475047 9486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:50.482342 9486 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46553
I20260811 04:52:50.482362 9561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46553 every 8 connection(s)
I20260811 04:52:50.483260 9486 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:50.486033 9562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:50.491473 9562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: Bootstrap starting.
I20260811 04:52:50.493633 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9486
I20260811 04:52:50.493789 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:50.494051 9562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:50.494069 18161 external_mini_cluster.cc:1428] Setting key 530f40240f7d3ec468f77503ddeede8b
I20260811 04:52:50.494868 9562 log.cc:824] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:50.497149 9562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: No bootstrap required, opened a new log
I20260811 04:52:50.501475 9562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } }
I20260811 04:52:50.501780 9562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:50.501855 9562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c9e41c66f6f40aea850503a2e51f7b4, State: Initialized, Role: FOLLOWER
I20260811 04:52:50.502344 9562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } }
I20260811 04:52:50.502499 9562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:50.502593 9562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:50.502705 9562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:50.503628 9562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } }
I20260811 04:52:50.503880 9566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:50.495241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:39251 (local address 127.0.0.1:46553)
0811 04:52:50.495706 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:50.495760 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:50.495803 (+ 43us) server_negotiation.cc:407] Connection header received
0811 04:52:50.496655 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:50.496679 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:50.497076 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:50.497428 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:50.497873 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:50.499356 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:50.500265 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:50.500944 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:50.501100 (+ 156us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:50.502087 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:50.502092 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:50.502105 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:50.502479 (+ 374us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:50.502566 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:50.502602 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:50.502746 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:50.502928 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 04:52:50.503083 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":157,"threads_started":1}
I20260811 04:52:50.503994 9562 leader_election.cc:302] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c9e41c66f6f40aea850503a2e51f7b4; no voters:
I20260811 04:52:50.504336 9562 leader_election.cc:288] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:50.504434 9567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:50.504650 9567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [term 1 LEADER]: Becoming Leader. State: Replica: 9c9e41c66f6f40aea850503a2e51f7b4, State: Running, Role: LEADER
I20260811 04:52:50.505014 9567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } }
I20260811 04:52:50.505721 9562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:50.506969 9569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c9e41c66f6f40aea850503a2e51f7b4. Latest consensus state: current_term: 1 leader_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } } }
I20260811 04:52:50.507184 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:50.508278 9568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c9e41c66f6f40aea850503a2e51f7b4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46553 } } }
I20260811 04:52:50.508782 9568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:50.508388 9569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4 [sys.catalog]: This master's current role is: LEADER
W20260811 04:52:50.511164 9581 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:52:50.511246 9581 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:52:50.511303 9588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:50.512127 9588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:50.514091 9566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:50.509522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:40839 (local address 127.0.0.1:46553)
0811 04:52:50.509648 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:50.509652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:50.509914 (+ 262us) server_negotiation.cc:407] Connection header received
0811 04:52:50.510035 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:50.510038 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:50.510079 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:50.510172 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:50.510432 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:50.510996 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:50.511946 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:50.512190 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:50.512306 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:50.513505 (+ 1199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:50.513509 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:50.513512 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:50.513527 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:50.513555 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:50.513568 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:50.513651 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:50.513926 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 04:52:50.513964 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 04:52:50.518687 9588 catalog_manager.cc:1347] Generated new cluster ID: 03b33db9df5546d2a0101bffdd5c8736
I20260811 04:52:50.518752 9588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:50.535641 9588 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:50.536875 9588 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:50.545198 9588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c9e41c66f6f40aea850503a2e51f7b4: Generated new TSK 0
I20260811 04:52:50.546029 9588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:50.556938 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9486
W20260811 04:52:50.566438 9470 connection.cc:535] client connection to 127.0.0.1:46553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46553): Connection reset by peer (error 104)
2026-08-11T04:52:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1487 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:50 dist-test-slave-njxd krb5kdc[9594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:50 dist-test-slave-njxd krb5kdc[9594](info): set up 2 sockets
Aug 11 04:52:50 dist-test-slave-njxd krb5kdc[9594](info): commencing operation
krb5kdc: starting...
W20260811 04:52:51.650205 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:51 dist-test-slave-njxd krb5kdc[9594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423971, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 04:52:51.784402 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38583
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:51.900630 9607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:51.901046 9607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:51.901136 9607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:51.905179 9607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:51.905282 9607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:51.905319 9607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:51.905356 9607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:51.905392 9607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:51.910816 9607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38583
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:51.911933 9607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:51.912979 9607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:51.921530 9613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:51.921615 9614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:51.921530 9616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:51.921908 9607 server_base.cc:1034] running on GCE node
I20260811 04:52:51.922453 9607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:51.923486 9607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:51.924659 9607 hybrid_clock.cc:648] HybridClock initialized: now 1786423971924620 us; error 49 us; skew 500 ppm
Aug 11 04:52:51 dist-test-slave-njxd krb5kdc[9594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423971, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:51.927472 9607 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 04:52:51.928308 9607 webserver.cc:460] Webserver started at http://127.0.0.1:45219/ using document root <none> and password file <none>
I20260811 04:52:51.928822 9607 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:51.928881 9607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:51.929045 9607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:51.931136 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b"
format_stamp: "Formatted at 2026-08-11 04:52:51 on dist-test-slave-njxd"
server_key: "34684997d126a95e289749cd97948c23"
server_key_iv: "6877e10d1a8a75c33debdb29f5396943"
server_key_version: "encryptionkey@0"
I20260811 04:52:51.931638 9607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b"
format_stamp: "Formatted at 2026-08-11 04:52:51 on dist-test-slave-njxd"
server_key: "34684997d126a95e289749cd97948c23"
server_key_iv: "6877e10d1a8a75c33debdb29f5396943"
server_key_version: "encryptionkey@0"
I20260811 04:52:51.935345 9607 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260811 04:52:51.937678 9624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:51.938895 9607 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:51.938992 9607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b"
format_stamp: "Formatted at 2026-08-11 04:52:51 on dist-test-slave-njxd"
server_key: "34684997d126a95e289749cd97948c23"
server_key_iv: "6877e10d1a8a75c33debdb29f5396943"
server_key_version: "encryptionkey@0"
I20260811 04:52:51.939083 9607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:51.943472 9607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:51.946750 9607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:51.946899 9607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:51.954437 9607 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38583
I20260811 04:52:51.954468 9681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38583 every 8 connection(s)
I20260811 04:52:51.955431 9607 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:51.958411 9682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:51.961828 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9607
I20260811 04:52:51.961977 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:51.962257 18161 external_mini_cluster.cc:1428] Setting key 1e4263bdfb0c837402bd63e7bdbea609
I20260811 04:52:51.964704 9682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: Bootstrap starting.
I20260811 04:52:51.967211 9682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:51.967888 9685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:51.963939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:50033 (local address 127.0.0.1:38583)
0811 04:52:51.964398 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:51.964413 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:51.964448 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:51.965145 (+ 697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:51.965166 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:51.965447 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:51.965841 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:51.966663 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:51.966667 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:51.966680 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:51.966689 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:51.966741 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:51.966760 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:51.966872 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:51.966983 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 04:52:51.967170 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":151,"threads_started":1}
I20260811 04:52:51.968017 9682 log.cc:824] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:51.970145 9682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: No bootstrap required, opened a new log
I20260811 04:52:51.970762 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:51.974680 9685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:51.972877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.106:50575 (local address 127.0.0.1:38583)
0811 04:52:51.973014 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:51.973018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:51.973234 (+ 216us) server_negotiation.cc:407] Connection header received
0811 04:52:51.973378 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:51.973380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:51.973408 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:51.973470 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:51.974221 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:51.974224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:51.974226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:51.974237 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:51.974260 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:51.974271 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:51.974338 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:51.974445 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 04:52:51.974477 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 04:52:51.974507 9682 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } }
I20260811 04:52:51.974828 9682 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:51.974890 9682 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2cf16d2fc5f48d1b5c013aa9365d89b, State: Initialized, Role: FOLLOWER
I20260811 04:52:51.975337 9682 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } }
I20260811 04:52:51.975468 9682 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:51.975605 9682 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:51.975735 9682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:51.976701 9682 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } }
I20260811 04:52:51.977084 9682 leader_election.cc:302] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2cf16d2fc5f48d1b5c013aa9365d89b; no voters:
I20260811 04:52:51.977402 9682 leader_election.cc:288] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:51.977528 9693 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:51.977815 9693 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [term 1 LEADER]: Becoming Leader. State: Replica: e2cf16d2fc5f48d1b5c013aa9365d89b, State: Running, Role: LEADER
I20260811 04:52:51.978214 9693 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } }
I20260811 04:52:51.978750 9682 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:51.980289 9694 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } } }
I20260811 04:52:51.980490 9694 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:51.980367 9696 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2cf16d2fc5f48d1b5c013aa9365d89b. Latest consensus state: current_term: 1 leader_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2cf16d2fc5f48d1b5c013aa9365d89b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38583 } } }
I20260811 04:52:51.980648 9696 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b [sys.catalog]: This master's current role is: LEADER
W20260811 04:52:51.983691 9710 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:52:51.983757 9710 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:52:51.983863 9709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:51.984555 9709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:51.989699 9709 catalog_manager.cc:1347] Generated new cluster ID: acdd7b902c22414888d1a19bc13a7c9e
I20260811 04:52:51.989763 9709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:52.025938 9709 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:52.026306 9709 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:52.030280 9709 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2cf16d2fc5f48d1b5c013aa9365d89b: Generated new TSK 0
I20260811 04:52:52.031023 9709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:52.043809 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9607
2026-08-11T04:52:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1484 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:52 dist-test-slave-njxd krb5kdc[9716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:52 dist-test-slave-njxd krb5kdc[9716](info): set up 2 sockets
Aug 11 04:52:52 dist-test-slave-njxd krb5kdc[9716](info): commencing operation
krb5kdc: starting...
W20260811 04:52:53.139169 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:53.265688 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:46871
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:42139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:46871
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:53.378618 9730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:53.378854 9730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:53.378919 9730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:53.383020 9730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:53.383078 9730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:53.383097 9730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:53.383112 9730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:53.383126 9730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:53.388228 9730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:42139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:46871
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:46871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:53.389315 9730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:53.390381 9730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:53.398790 9735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:53.398828 9738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:53.398828 9736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:53.399096 9730 server_base.cc:1034] running on GCE node
I20260811 04:52:53.399705 9730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:53.400705 9730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:53.401866 9730 hybrid_clock.cc:648] HybridClock initialized: now 1786423973401838 us; error 39 us; skew 500 ppm
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423973, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:53.404590 9730 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:53.405462 9730 webserver.cc:460] Webserver started at http://127.17.188.126:44703/ using document root <none> and password file <none>
I20260811 04:52:53.406078 9730 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:53.406178 9730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:53.406404 9730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:53.408401 9730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "b9e3dfb3493d4bef95c3d96753f49651"
format_stamp: "Formatted at 2026-08-11 04:52:53 on dist-test-slave-njxd"
server_key: "78a0f46917d439a244c05e7e2b13a06d"
server_key_iv: "42cda46f6ab9eea7082e8342c637ba10"
server_key_version: "encryptionkey@0"
I20260811 04:52:53.409008 9730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "b9e3dfb3493d4bef95c3d96753f49651"
format_stamp: "Formatted at 2026-08-11 04:52:53 on dist-test-slave-njxd"
server_key: "78a0f46917d439a244c05e7e2b13a06d"
server_key_iv: "42cda46f6ab9eea7082e8342c637ba10"
server_key_version: "encryptionkey@0"
I20260811 04:52:53.412791 9730 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:52:53.415364 9745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:53.416567 9730 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:52:53.416709 9730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "b9e3dfb3493d4bef95c3d96753f49651"
format_stamp: "Formatted at 2026-08-11 04:52:53 on dist-test-slave-njxd"
server_key: "78a0f46917d439a244c05e7e2b13a06d"
server_key_iv: "42cda46f6ab9eea7082e8342c637ba10"
server_key_version: "encryptionkey@0"
I20260811 04:52:53.416821 9730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:53.439174 9730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:53.442528 9730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:53.442788 9730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:53.450340 9730 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:46871
I20260811 04:52:53.450371 9802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:46871 every 8 connection(s)
I20260811 04:52:53.451336 9730 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:53.453102 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9730
I20260811 04:52:53.453244 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:53.453519 18161 external_mini_cluster.cc:1428] Setting key 528ade433dfe13886eea745401398a47
I20260811 04:52:53.454226 9803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:53.460713 9803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651: Bootstrap starting.
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423973, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:53.463238 9803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:53.464104 9803 log.cc:824] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:53.466544 9803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651: No bootstrap required, opened a new log
I20260811 04:52:53.469208 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:53.455008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52075 (local address 127.17.188.126:46871)
0811 04:52:53.455467 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:53.455482 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:53.455518 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:52:53.456179 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:53.456196 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:53.456521 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:53.456852 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:53.457764 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:53.459285 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:53.460178 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:53.460870 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:53.461030 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:53.463778 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:53.463784 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:53.463800 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:53.463830 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:53.465971 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:53.466464 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:53.466470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:53.466476 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:53.466620 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:53.466947 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:53.466950 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:53.466952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:53.467450 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:53.467670 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:53.467977 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 04:52:53.468203 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":150,"threads_started":1}
I20260811 04:52:53.470978 9803 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } }
I20260811 04:52:53.471269 9803 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:53.471333 9803 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9e3dfb3493d4bef95c3d96753f49651, State: Initialized, Role: FOLLOWER
I20260811 04:52:53.471824 9803 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } }
I20260811 04:52:53.471978 9803 raft_consensus.cc:388] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:53.472048 9803 raft_consensus.cc:482] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:53.472146 9803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:53.472395 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:53.473359 9803 raft_consensus.cc:504] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } }
I20260811 04:52:53.473753 9803 leader_election.cc:302] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b9e3dfb3493d4bef95c3d96753f49651; no voters:
I20260811 04:52:53.474169 9803 leader_election.cc:288] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:53.474277 9813 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:53.474510 9813 raft_consensus.cc:686] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [term 1 LEADER]: Becoming Leader. State: Replica: b9e3dfb3493d4bef95c3d96753f49651, State: Running, Role: LEADER
I20260811 04:52:53.474928 9813 consensus_queue.cc:237] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } }
I20260811 04:52:53.475523 9803 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:53.476790 9814 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b9e3dfb3493d4bef95c3d96753f49651. Latest consensus state: current_term: 1 leader_uuid: "b9e3dfb3493d4bef95c3d96753f49651" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } } }
I20260811 04:52:53.476938 9814 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:53.477361 9823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:53.477324 9815 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b9e3dfb3493d4bef95c3d96753f49651" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b9e3dfb3493d4bef95c3d96753f49651" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 46871 } } }
I20260811 04:52:53.477463 9815 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:53.480676 9823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:53.484393 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:53.475133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35377 (local address 127.17.188.126:46871)
0811 04:52:53.475242 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:53.475246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:53.475448 (+ 202us) server_negotiation.cc:407] Connection header received
0811 04:52:53.475556 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:53.475559 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:53.475609 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:53.475709 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:53.476856 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:53.477709 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:53.478548 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:53.478869 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:53.478974 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:53.480619 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:53.480623 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:53.480628 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:53.480656 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:53.482448 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:53.483045 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:53.483049 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:53.483050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:53.483139 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:53.483495 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:53.483498 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:53.483500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:53.483680 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:53.483841 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:53.484116 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 04:52:53.484213 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 04:52:53.486999 9823 catalog_manager.cc:1347] Generated new cluster ID: 7ae0846d417d43a1a9cf80857fce353a
I20260811 04:52:53.487061 9823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:53.498836 9823 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:53.499750 9823 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:53.515064 9823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b9e3dfb3493d4bef95c3d96753f49651: Generated new TSK 0
I20260811 04:52:53.515756 9823 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:53.519294 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9730
W20260811 04:52:53.530807 9714 connection.cc:535] client connection to 127.17.188.126:46871 recv error: Network error: failed to read from TLS socket (remote: 127.17.188.126:46871): Connection reset by peer (error 104)
2026-08-11T04:52:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1479 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9836](info): set up 2 sockets
Aug 11 04:52:53 dist-test-slave-njxd krb5kdc[9836](info): commencing operation
krb5kdc: starting...
W20260811 04:52:54.601722 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:54 dist-test-slave-njxd krb5kdc[9836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423974, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:54.729180 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36211
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:36211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:54.837083 9852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:54.837313 9852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:54.837352 9852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:54.841130 9852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:54.841177 9852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:54.841195 9852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:54.841212 9852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:54.841225 9852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:54.846431 9852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:36211
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:36211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:54.847323 9852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:54.848230 9852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:54.856434 9861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:54.856442 9859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:54.856447 9858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:54.856513 9852 server_base.cc:1034] running on GCE node
I20260811 04:52:54.857275 9852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:54.858345 9852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:54.859517 9852 hybrid_clock.cc:648] HybridClock initialized: now 1786423974859499 us; error 30 us; skew 500 ppm
Aug 11 04:52:54 dist-test-slave-njxd krb5kdc[9836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423974, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:54.862263 9852 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:54.863111 9852 webserver.cc:460] Webserver started at http://127.17.188.126:34077/ using document root <none> and password file <none>
I20260811 04:52:54.863659 9852 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:54.863749 9852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:54.863978 9852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:54.866045 9852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "88175d746e3342d0af1097798b06087e"
format_stamp: "Formatted at 2026-08-11 04:52:54 on dist-test-slave-njxd"
server_key: "84bdafe6c183595685ba50945b550f97"
server_key_iv: "2cc602f78f1eaaabc00922b7a5686cd9"
server_key_version: "encryptionkey@0"
I20260811 04:52:54.866613 9852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "88175d746e3342d0af1097798b06087e"
format_stamp: "Formatted at 2026-08-11 04:52:54 on dist-test-slave-njxd"
server_key: "84bdafe6c183595685ba50945b550f97"
server_key_iv: "2cc602f78f1eaaabc00922b7a5686cd9"
server_key_version: "encryptionkey@0"
I20260811 04:52:54.870149 9852 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s
I20260811 04:52:54.872493 9868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:54.873764 9852 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:54.873895 9852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "88175d746e3342d0af1097798b06087e"
format_stamp: "Formatted at 2026-08-11 04:52:54 on dist-test-slave-njxd"
server_key: "84bdafe6c183595685ba50945b550f97"
server_key_iv: "2cc602f78f1eaaabc00922b7a5686cd9"
server_key_version: "encryptionkey@0"
I20260811 04:52:54.874002 9852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:54.886451 9852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:54.889122 9852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:54.889268 9852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:54.896181 9852 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:36211
I20260811 04:52:54.896252 9923 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:36211 every 8 connection(s)
I20260811 04:52:54.897119 9852 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:54.899814 9924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:54.904908 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9852
I20260811 04:52:54.905095 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:54.905198 9924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: Bootstrap starting.
I20260811 04:52:54.905427 18161 external_mini_cluster.cc:1428] Setting key ae9785cceba9737caf907abe717f25bd
I20260811 04:52:54.907735 9924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:54.908540 9924 log.cc:824] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:54.910912 9924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: No bootstrap required, opened a new log
I20260811 04:52:54.915143 9924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } }
I20260811 04:52:54.915328 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:54.906802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36353 (local address 127.17.188.126:36211)
0811 04:52:54.907239 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:54.907255 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:54.907290 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:54.907949 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:54.907967 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:54.908306 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:54.908722 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:54.909138 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:54.910674 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:54.911906 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:54.912382 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:54.912505 (+ 123us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:54.913452 (+ 947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:54.913457 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:54.913470 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:54.913926 (+ 456us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:54.913983 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:54.914007 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:54.914124 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:54.914402 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 04:52:54.914565 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":150,"threads_started":1}
I20260811 04:52:54.915366 9924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:54.915464 9924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88175d746e3342d0af1097798b06087e, State: Initialized, Role: FOLLOWER
I20260811 04:52:54.915848 9924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } }
I20260811 04:52:54.915964 9924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:54.916047 9924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:54.916174 9924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:54.917042 9924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } }
I20260811 04:52:54.917412 9924 leader_election.cc:302] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88175d746e3342d0af1097798b06087e; no voters:
I20260811 04:52:54.917806 9924 leader_election.cc:288] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:54.917873 9929 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:54.918090 9929 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [term 1 LEADER]: Becoming Leader. State: Replica: 88175d746e3342d0af1097798b06087e, State: Running, Role: LEADER
I20260811 04:52:54.918432 9929 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } }
I20260811 04:52:54.918465 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:54.919059 9924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:54.919585 9929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88175d746e3342d0af1097798b06087e. Latest consensus state: current_term: 1 leader_uuid: "88175d746e3342d0af1097798b06087e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } } }
I20260811 04:52:54.919703 9929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:54.920397 9931 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88175d746e3342d0af1097798b06087e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88175d746e3342d0af1097798b06087e" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 36211 } } }
I20260811 04:52:54.920512 9931 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e [sys.catalog]: This master's current role is: LEADER
W20260811 04:52:54.924376 9952 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:52:54.924458 9952 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:52:54.924554 9937 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:54.925292 9937 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:54.926298 9927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:54.922316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45077 (local address 127.17.188.126:36211)
0811 04:52:54.922430 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:54.922435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:54.922628 (+ 193us) server_negotiation.cc:407] Connection header received
0811 04:52:54.922766 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:54.922769 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:54.922816 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:54.922902 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:54.923161 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:54.923673 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:54.924554 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:54.924847 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:54.924960 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:54.925859 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:54.925862 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:54.925865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:54.925876 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:54.925909 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:54.925919 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:54.926015 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:54.926135 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 04:52:54.926167 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 04:52:54.930799 9937 catalog_manager.cc:1347] Generated new cluster ID: 6762b583feea492490ff6ade73586d8d
I20260811 04:52:54.930871 9937 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:54.952711 9937 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:54.953928 9937 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:54.961503 9937 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88175d746e3342d0af1097798b06087e: Generated new TSK 0
I20260811 04:52:54.962436 9937 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:54.974994 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9852
W20260811 04:52:54.983968 9834 connection.cc:535] client connection to 127.17.188.126:36211 recv error: Network error: failed to read from TLS socket (remote: 127.17.188.126:36211): Connection reset by peer (error 104)
2026-08-11T04:52:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:55 dist-test-slave-njxd krb5kdc[9958](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:55 dist-test-slave-njxd krb5kdc[9958](info): set up 2 sockets
Aug 11 04:52:55 dist-test-slave-njxd krb5kdc[9958](info): commencing operation
krb5kdc: starting...
W20260811 04:52:56.099488 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.101s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:56 dist-test-slave-njxd krb5kdc[9958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423976, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:56.232798 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44779
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:43293
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:44779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:56.345054 9972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:56.345348 9972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:56.345423 9972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:56.349295 9972 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:56.349383 9972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:56.349422 9972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:56.349480 9972 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:56.349519 9972 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:56.354674 9972 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:43293
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:44779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9972
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:56.355682 9972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:56.356712 9972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:56.364676 9980 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:56.364676 9977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:56.364944 9972 server_base.cc:1034] running on GCE node
W20260811 04:52:56.364663 9978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:56.365540 9972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:56.366649 9972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:56.367842 9972 hybrid_clock.cc:648] HybridClock initialized: now 1786423976367824 us; error 31 us; skew 500 ppm
Aug 11 04:52:56 dist-test-slave-njxd krb5kdc[9958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423976, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:56.370570 9972 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:56.371397 9972 webserver.cc:460] Webserver started at http://127.17.188.126:41213/ using document root <none> and password file <none>
I20260811 04:52:56.371909 9972 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:56.371994 9972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:56.372226 9972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:56.374193 9972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "0077b927a5314f1c83327fbaa8e04360"
format_stamp: "Formatted at 2026-08-11 04:52:56 on dist-test-slave-njxd"
server_key: "28a6093f3a546d21a697cbfb473d389c"
server_key_iv: "e7d1fb524624171df203aa2482dd1131"
server_key_version: "encryptionkey@0"
I20260811 04:52:56.374775 9972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "0077b927a5314f1c83327fbaa8e04360"
format_stamp: "Formatted at 2026-08-11 04:52:56 on dist-test-slave-njxd"
server_key: "28a6093f3a546d21a697cbfb473d389c"
server_key_iv: "e7d1fb524624171df203aa2482dd1131"
server_key_version: "encryptionkey@0"
I20260811 04:52:56.378353 9972 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:52:56.380609 9987 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:56.381811 9972 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:52:56.381942 9972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "0077b927a5314f1c83327fbaa8e04360"
format_stamp: "Formatted at 2026-08-11 04:52:56 on dist-test-slave-njxd"
server_key: "28a6093f3a546d21a697cbfb473d389c"
server_key_iv: "e7d1fb524624171df203aa2482dd1131"
server_key_version: "encryptionkey@0"
I20260811 04:52:56.382052 9972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:56.386410 9972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:56.389086 9972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:56.389292 9972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:56.396239 9972 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:44779
I20260811 04:52:56.396278 10043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:44779 every 8 connection(s)
I20260811 04:52:56.397104 9972 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:56.399550 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 9972
I20260811 04:52:56.399708 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:56.399958 10044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:56.400061 18161 external_mini_cluster.cc:1428] Setting key 028c2315107e470b8cbde1d16d1712b6
I20260811 04:52:56.405130 10047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:56.401415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35067 (local address 127.17.188.126:44779)
0811 04:52:56.401838 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:56.401853 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:56.401885 (+ 32us) server_negotiation.cc:407] Connection header received
0811 04:52:56.402638 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:56.402656 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:56.402923 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:56.403265 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:56.404060 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:56.404064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:56.404077 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:56.404086 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:56.404135 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:56.404153 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:56.404293 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:56.404362 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 04:52:56.404509 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":145,"threads_started":1}
I20260811 04:52:56.406546 10044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360: Bootstrap starting.
I20260811 04:52:56.407931 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:56.408948 10044 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:56.409863 10044 log.cc:824] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:56.411404 10047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:56.409815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51605 (local address 127.17.188.126:44779)
0811 04:52:56.409936 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:56.409943 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:56.410090 (+ 147us) server_negotiation.cc:407] Connection header received
0811 04:52:56.410180 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:56.410184 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:56.410215 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:56.410298 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:56.411028 (+ 730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:56.411031 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:56.411033 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:56.411045 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:56.411084 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:56.411096 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:56.411199 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:56.411248 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 04:52:56.411280 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:52:56.412175 10044 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360: No bootstrap required, opened a new log
I20260811 04:52:56.415670 10044 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } }
I20260811 04:52:56.415915 10044 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:56.416000 10044 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0077b927a5314f1c83327fbaa8e04360, State: Initialized, Role: FOLLOWER
I20260811 04:52:56.416414 10044 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } }
I20260811 04:52:56.416575 10044 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:56.416664 10044 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:56.416764 10044 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:56.417734 10044 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } }
I20260811 04:52:56.418077 10044 leader_election.cc:302] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0077b927a5314f1c83327fbaa8e04360; no voters:
I20260811 04:52:56.418390 10044 leader_election.cc:288] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:56.418505 10055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:56.418797 10055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [term 1 LEADER]: Becoming Leader. State: Replica: 0077b927a5314f1c83327fbaa8e04360, State: Running, Role: LEADER
I20260811 04:52:56.419185 10055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } }
I20260811 04:52:56.419706 10044 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:56.420950 10056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0077b927a5314f1c83327fbaa8e04360" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } } }
I20260811 04:52:56.421089 10056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:56.421504 10057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0077b927a5314f1c83327fbaa8e04360. Latest consensus state: current_term: 1 leader_uuid: "0077b927a5314f1c83327fbaa8e04360" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0077b927a5314f1c83327fbaa8e04360" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44779 } } }
I20260811 04:52:56.421639 10057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:56.421486 10064 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:56.424649 10064 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:56.429838 10064 catalog_manager.cc:1347] Generated new cluster ID: 8e7843a224ce40c8a388b25148dca83a
I20260811 04:52:56.429905 10064 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:56.447762 10064 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:56.448125 10064 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:56.455559 10064 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0077b927a5314f1c83327fbaa8e04360: Generated new TSK 0
I20260811 04:52:56.456321 10064 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:56.468729 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 9972
2026-08-11T04:52:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:56 dist-test-slave-njxd krb5kdc[10077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:56 dist-test-slave-njxd krb5kdc[10077](info): set up 2 sockets
Aug 11 04:52:56 dist-test-slave-njxd krb5kdc[10077](info): commencing operation
krb5kdc: starting...
W20260811 04:52:57.550639 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:57.682749 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39005
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:39005
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:57.792512 10092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:57.792779 10092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:57.792819 10092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:57.796716 10092 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:57.796777 10092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:57.796797 10092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:57.796811 10092 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:57.796825 10092 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:57.802179 10092 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:39005
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:39005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:57.803194 10092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:57.804163 10092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:57.812400 10100 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:57.812417 10097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:57.812427 10098 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:57.812568 10092 server_base.cc:1034] running on GCE node
I20260811 04:52:57.813306 10092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:57.814389 10092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:57.815548 10092 hybrid_clock.cc:648] HybridClock initialized: now 1786423977815530 us; error 29 us; skew 500 ppm
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423977, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:57.818324 10092 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:57.819188 10092 webserver.cc:460] Webserver started at http://127.17.188.126:38153/ using document root <none> and password file <none>
I20260811 04:52:57.819748 10092 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:57.819847 10092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:57.820075 10092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:57.822149 10092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "fe74a30428d64acabd4324862731d399"
format_stamp: "Formatted at 2026-08-11 04:52:57 on dist-test-slave-njxd"
server_key: "cd5692ce90c04c363451ce510631db9d"
server_key_iv: "0c69544be23289cefa9b6b3b7938616f"
server_key_version: "encryptionkey@0"
I20260811 04:52:57.822690 10092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "fe74a30428d64acabd4324862731d399"
format_stamp: "Formatted at 2026-08-11 04:52:57 on dist-test-slave-njxd"
server_key: "cd5692ce90c04c363451ce510631db9d"
server_key_iv: "0c69544be23289cefa9b6b3b7938616f"
server_key_version: "encryptionkey@0"
I20260811 04:52:57.826195 10092 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:57.828397 10108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:57.829535 10092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 04:52:57.829687 10092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "fe74a30428d64acabd4324862731d399"
format_stamp: "Formatted at 2026-08-11 04:52:57 on dist-test-slave-njxd"
server_key: "cd5692ce90c04c363451ce510631db9d"
server_key_iv: "0c69544be23289cefa9b6b3b7938616f"
server_key_version: "encryptionkey@0"
I20260811 04:52:57.829800 10092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:57.842065 10092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:57.845218 10092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:57.845445 10092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:57.852639 10092 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:39005
I20260811 04:52:57.852650 10169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:39005 every 8 connection(s)
I20260811 04:52:57.853644 10092 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:57.856410 10170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:57.859277 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10092
I20260811 04:52:57.859431 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:57.859752 18161 external_mini_cluster.cc:1428] Setting key e77cb8e4baea661c1e7be47b2c1bf1b7
I20260811 04:52:57.862478 10170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399: Bootstrap starting.
I20260811 04:52:57.864567 10170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:57.865270 10170 log.cc:824] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:57.867367 10170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399: No bootstrap required, opened a new log
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423977, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:52:57.871928 10170 raft_consensus.cc:348] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } }
I20260811 04:52:57.872221 10170 raft_consensus.cc:374] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:57.872309 10170 raft_consensus.cc:729] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe74a30428d64acabd4324862731d399, State: Initialized, Role: FOLLOWER
I20260811 04:52:57.872815 10170 consensus_queue.cc:260] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } }
I20260811 04:52:57.872989 10170 raft_consensus.cc:388] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:57.873063 10170 raft_consensus.cc:482] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:57.873183 10170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:57.874193 10170 raft_consensus.cc:504] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } }
I20260811 04:52:57.874497 10173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:57.861188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50915 (local address 127.17.188.126:39005)
0811 04:52:57.861700 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:57.861721 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:57.861756 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:57.862368 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:57.862384 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:57.862769 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:57.863093 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:57.863901 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:57.864850 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:57.865872 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:57.866492 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:57.866656 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:57.869308 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:57.869314 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:57.869331 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:57.869361 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:57.871402 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:57.871826 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:57.871832 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:57.871838 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:57.871980 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:57.872283 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:57.872288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:57.872291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:57.872832 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:57.873043 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:57.873360 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 04:52:57.873719 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":144,"threads_started":1}
I20260811 04:52:57.874585 10170 leader_election.cc:302] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe74a30428d64acabd4324862731d399; no voters:
I20260811 04:52:57.874953 10170 leader_election.cc:288] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:57.875047 10176 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:57.875259 10176 raft_consensus.cc:686] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [term 1 LEADER]: Becoming Leader. State: Replica: fe74a30428d64acabd4324862731d399, State: Running, Role: LEADER
I20260811 04:52:57.875605 10176 consensus_queue.cc:237] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } }
I20260811 04:52:57.876219 10170 sys_catalog.cc:564] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:57.876809 10176 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe74a30428d64acabd4324862731d399. Latest consensus state: current_term: 1 leader_uuid: "fe74a30428d64acabd4324862731d399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } } }
I20260811 04:52:57.876994 10176 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:57.877281 10177 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe74a30428d64acabd4324862731d399" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe74a30428d64acabd4324862731d399" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 39005 } } }
I20260811 04:52:57.877415 10177 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:57.877542 10186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:57.877697 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:57.880860 10186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:57.887290 10186 catalog_manager.cc:1347] Generated new cluster ID: 5f58d8dd849e4cbf81b39f48b53ae052
I20260811 04:52:57.887356 10186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:57.890219 10173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:57.880275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49813 (local address 127.17.188.126:39005)
0811 04:52:57.880383 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:57.880387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:57.880942 (+ 555us) server_negotiation.cc:407] Connection header received
0811 04:52:57.881087 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:57.881090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:57.881148 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:57.881201 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:57.882321 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:57.883137 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:57.884240 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:57.884611 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:57.884752 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:57.886549 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:57.886553 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:57.886556 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:52:57.886580 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:57.888181 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:57.888610 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:57.888618 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:57.888620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:57.888693 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:52:57.888987 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:52:57.888991 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:52:57.888993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:52:57.889278 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:57.889448 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:57.889865 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 04:52:57.890009 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 04:52:57.905359 10186 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:57.906351 10186 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:57.912717 10186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fe74a30428d64acabd4324862731d399: Generated new TSK 0
I20260811 04:52:57.913414 10186 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:57.917145 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10092
2026-08-11T04:52:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10205](info): set up 2 sockets
Aug 11 04:52:57 dist-test-slave-njxd krb5kdc[10205](info): commencing operation
krb5kdc: starting...
W20260811 04:52:59.010262 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:52:59 dist-test-slave-njxd krb5kdc[10205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:52:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:52:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:52:59.142272 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35127
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:41355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:35127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:52:59.251273 10218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:52:59.251577 10218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:52:59.251674 10218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:52:59.255661 10218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:52:59.255754 10218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:52:59.255793 10218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:52:59.255852 10218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:52:59.255895 10218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:52:59.261088 10218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:41355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:35127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:35127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:52:59.262215 10218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:52:59.263245 10218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:52:59.271596 10226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:52:59.271652 10223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:59.271700 10218 server_base.cc:1034] running on GCE node
W20260811 04:52:59.271652 10224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:52:59.272485 10218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:52:59.273561 10218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:52:59.274828 10218 hybrid_clock.cc:648] HybridClock initialized: now 1786423979274800 us; error 42 us; skew 500 ppm
Aug 11 04:52:59 dist-test-slave-njxd krb5kdc[10205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423979, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:52:59.277540 10218 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:52:59.278431 10218 webserver.cc:460] Webserver started at http://127.17.188.126:43195/ using document root <none> and password file <none>
I20260811 04:52:59.278990 10218 fs_manager.cc:359] Metadata directory not provided
I20260811 04:52:59.279079 10218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:52:59.279315 10218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:52:59.281299 10218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "5fd57c8385be4603bdbe0fda30654042"
format_stamp: "Formatted at 2026-08-11 04:52:59 on dist-test-slave-njxd"
server_key: "ccc474272fd4591eb3b9b34a75328da6"
server_key_iv: "27c45424be78ded8f38337438d3d81b4"
server_key_version: "encryptionkey@0"
I20260811 04:52:59.281890 10218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "5fd57c8385be4603bdbe0fda30654042"
format_stamp: "Formatted at 2026-08-11 04:52:59 on dist-test-slave-njxd"
server_key: "ccc474272fd4591eb3b9b34a75328da6"
server_key_iv: "27c45424be78ded8f38337438d3d81b4"
server_key_version: "encryptionkey@0"
I20260811 04:52:59.285751 10218 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 04:52:59.288985 10234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:52:59.290329 10218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:52:59.290431 10218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "5fd57c8385be4603bdbe0fda30654042"
format_stamp: "Formatted at 2026-08-11 04:52:59 on dist-test-slave-njxd"
server_key: "ccc474272fd4591eb3b9b34a75328da6"
server_key_iv: "27c45424be78ded8f38337438d3d81b4"
server_key_version: "encryptionkey@0"
I20260811 04:52:59.290586 10218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:52:59.305934 10218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:52:59.308761 10218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:52:59.308957 10218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:52:59.316342 10218 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:35127
I20260811 04:52:59.316373 10289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:35127 every 8 connection(s)
I20260811 04:52:59.317310 10218 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:52:59.318475 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10218
I20260811 04:52:59.318646 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:52:59.318987 18161 external_mini_cluster.cc:1428] Setting key e6ee5e0d05fe7334999399605f18a78c
I20260811 04:52:59.320750 10290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:52:59.326327 10290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042: Bootstrap starting.
I20260811 04:52:59.327786 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:59.320426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45577 (local address 127.17.188.126:35127)
0811 04:52:59.320938 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:59.320954 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:59.320989 (+ 35us) server_negotiation.cc:407] Connection header received
0811 04:52:59.321713 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:59.321731 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:59.322054 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:59.322384 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:59.322768 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:59.323701 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:59.324575 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:59.325033 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:59.325200 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:59.326115 (+ 915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:59.326119 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:59.326132 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:59.326563 (+ 431us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:59.326616 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:59.326640 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:59.326758 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:59.326912 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 04:52:59.327113 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":145,"threads_started":1}
I20260811 04:52:59.328615 10290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042: Neither blocks nor log segments found. Creating new log.
I20260811 04:52:59.329483 10290 log.cc:824] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042: Log is configured to *not* fsync() on all Append() calls
I20260811 04:52:59.330765 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:52:59.331599 10290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042: No bootstrap required, opened a new log
I20260811 04:52:59.335160 10290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } }
I20260811 04:52:59.335436 10290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:52:59.335484 10290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fd57c8385be4603bdbe0fda30654042, State: Initialized, Role: FOLLOWER
I20260811 04:52:59.335974 10290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } }
I20260811 04:52:59.336156 10290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:52:59.336233 10290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:52:59.336344 10290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:52:59.337364 10294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:52:59.332766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55097 (local address 127.17.188.126:35127)
0811 04:52:59.332890 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 04:52:59.332895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:52:59.333106 (+ 211us) server_negotiation.cc:407] Connection header received
0811 04:52:59.333226 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:52:59.333228 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:52:59.333262 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:52:59.333323 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:52:59.333661 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:59.334640 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:59.335788 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:52:59.336018 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:52:59.336095 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:52:59.336934 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:52:59.336936 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:52:59.336938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:52:59.336950 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:52:59.336975 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:52:59.336985 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:52:59.337041 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 04:52:59.337170 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 04:52:59.337224 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 04:52:59.337705 10290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } }
I20260811 04:52:59.338071 10290 leader_election.cc:302] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5fd57c8385be4603bdbe0fda30654042; no voters:
I20260811 04:52:59.338342 10290 leader_election.cc:288] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:52:59.338456 10304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:52:59.338800 10304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [term 1 LEADER]: Becoming Leader. State: Replica: 5fd57c8385be4603bdbe0fda30654042, State: Running, Role: LEADER
I20260811 04:52:59.339179 10304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } }
I20260811 04:52:59.339792 10290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:52:59.341027 10306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5fd57c8385be4603bdbe0fda30654042. Latest consensus state: current_term: 1 leader_uuid: "5fd57c8385be4603bdbe0fda30654042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } } }
I20260811 04:52:59.341174 10306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:59.341332 10305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5fd57c8385be4603bdbe0fda30654042" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5fd57c8385be4603bdbe0fda30654042" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 35127 } } }
I20260811 04:52:59.341428 10305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042 [sys.catalog]: This master's current role is: LEADER
I20260811 04:52:59.341699 10314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:52:59.344548 10314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:52:59.350521 10314 catalog_manager.cc:1347] Generated new cluster ID: 1be8b244fb4e4dc4bd81ac29348a76c4
I20260811 04:52:59.350601 10314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:52:59.384761 10314 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:52:59.386153 10314 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:52:59.391667 10314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5fd57c8385be4603bdbe0fda30654042: Generated new TSK 0
I20260811 04:52:59.392450 10314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:52:59.404352 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10218
2026-08-11T04:52:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1486 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:52:59 dist-test-slave-njxd krb5kdc[10328](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:52:59 dist-test-slave-njxd krb5kdc[10328](info): set up 2 sockets
Aug 11 04:52:59 dist-test-slave-njxd krb5kdc[10328](info): commencing operation
krb5kdc: starting...
W20260811 04:53:00.498970 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:53:00 dist-test-slave-njxd krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423980, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:53:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:53:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:53:00.632339 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44701
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:36221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:44701
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:53:00.745230 10342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:00.745523 10342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:00.745657 10342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:53:00.749737 10342 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:00.749800 10342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:00.749820 10342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:00.749838 10342 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:00.749853 10342 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:00.755230 10342 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:36221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:44701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:44701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10342
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:00.756254 10342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:00.757248 10342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:53:00.765712 10342 server_base.cc:1034] running on GCE node
W20260811 04:53:00.765666 10349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:00.765661 10351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:00.765666 10348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:00.766533 10342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:00.767586 10342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:00.768788 10342 hybrid_clock.cc:648] HybridClock initialized: now 1786423980768772 us; error 38 us; skew 500 ppm
Aug 11 04:53:00 dist-test-slave-njxd krb5kdc[10328](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423980, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:00.771629 10342 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:53:00.772455 10342 webserver.cc:460] Webserver started at http://127.17.188.126:35399/ using document root <none> and password file <none>
I20260811 04:53:00.772938 10342 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:00.772993 10342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:00.773150 10342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:00.775168 10342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "d3217ece891847e6afb85e057dd72d5a"
format_stamp: "Formatted at 2026-08-11 04:53:00 on dist-test-slave-njxd"
server_key: "82ca953c4855f0cb03a88a8d32e90337"
server_key_iv: "94d6a99a47e1a64d8b5924d9fd7555b5"
server_key_version: "encryptionkey@0"
I20260811 04:53:00.775676 10342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "d3217ece891847e6afb85e057dd72d5a"
format_stamp: "Formatted at 2026-08-11 04:53:00 on dist-test-slave-njxd"
server_key: "82ca953c4855f0cb03a88a8d32e90337"
server_key_iv: "94d6a99a47e1a64d8b5924d9fd7555b5"
server_key_version: "encryptionkey@0"
I20260811 04:53:00.779183 10342 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 04:53:00.781371 10358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:00.782584 10342 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:53:00.782702 10342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "d3217ece891847e6afb85e057dd72d5a"
format_stamp: "Formatted at 2026-08-11 04:53:00 on dist-test-slave-njxd"
server_key: "82ca953c4855f0cb03a88a8d32e90337"
server_key_iv: "94d6a99a47e1a64d8b5924d9fd7555b5"
server_key_version: "encryptionkey@0"
I20260811 04:53:00.782802 10342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:00.787086 10342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:00.790284 10342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:00.790469 10342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:00.797210 10342 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:44701
I20260811 04:53:00.797219 10412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:44701 every 8 connection(s)
I20260811 04:53:00.798175 10342 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:53:00.799393 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10342
I20260811 04:53:00.799546 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:53:00.799860 18161 external_mini_cluster.cc:1428] Setting key a8e0bf16627fdae12982a0a718c3291d
I20260811 04:53:00.801231 10413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:00.805394 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:00.801136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41565 (local address 127.17.188.126:44701)
0811 04:53:00.801609 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:00.801628 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:00.801670 (+ 42us) server_negotiation.cc:407] Connection header received
0811 04:53:00.802492 (+ 822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:00.802515 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:00.802871 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:00.803219 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:00.803900 (+ 681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:00.803906 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:00.803920 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:53:00.803930 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:00.804008 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:53:00.804036 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:00.804190 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:00.804311 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 04:53:00.804466 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":143,"threads_started":1}
I20260811 04:53:00.808184 10413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a: Bootstrap starting.
I20260811 04:53:00.808347 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:53:00.810612 10413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:00.811368 10413 log.cc:824] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:00.812278 10416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:00.810514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50511 (local address 127.17.188.126:44701)
0811 04:53:00.810630 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:00.810636 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:00.810857 (+ 221us) server_negotiation.cc:407] Connection header received
0811 04:53:00.811015 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:00.811018 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:00.811063 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:00.811152 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:00.811873 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:00.811877 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:00.811880 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 04:53:00.811891 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:00.811917 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 04:53:00.811935 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:00.812023 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:00.812099 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 04:53:00.812138 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 04:53:00.813759 10413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a: No bootstrap required, opened a new log
I20260811 04:53:00.817550 10413 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } }
I20260811 04:53:00.817867 10413 raft_consensus.cc:374] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 04:53:00.817930 10413 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3217ece891847e6afb85e057dd72d5a, State: Initialized, Role: FOLLOWER
I20260811 04:53:00.818383 10413 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } }
I20260811 04:53:00.818536 10413 raft_consensus.cc:388] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 04:53:00.818605 10413 raft_consensus.cc:482] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 04:53:00.818703 10413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:00.819705 10413 raft_consensus.cc:504] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } }
I20260811 04:53:00.820041 10413 leader_election.cc:302] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3217ece891847e6afb85e057dd72d5a; no voters:
I20260811 04:53:00.820396 10413 leader_election.cc:288] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 04:53:00.820514 10423 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:53:00.820801 10423 raft_consensus.cc:686] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [term 1 LEADER]: Becoming Leader. State: Replica: d3217ece891847e6afb85e057dd72d5a, State: Running, Role: LEADER
I20260811 04:53:00.821135 10423 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } }
I20260811 04:53:00.821741 10413 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:00.822327 10423 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3217ece891847e6afb85e057dd72d5a. Latest consensus state: current_term: 1 leader_uuid: "d3217ece891847e6afb85e057dd72d5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } } }
I20260811 04:53:00.822515 10423 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:00.822788 10424 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3217ece891847e6afb85e057dd72d5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3217ece891847e6afb85e057dd72d5a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 44701 } } }
I20260811 04:53:00.822916 10424 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:00.823037 10431 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:53:00.826002 10431 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:53:00.831969 10431 catalog_manager.cc:1347] Generated new cluster ID: b37144c7647f4c83b078f8650fa808a0
I20260811 04:53:00.832046 10431 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:53:00.846107 10431 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:53:00.846454 10431 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:53:00.861261 10431 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d3217ece891847e6afb85e057dd72d5a: Generated new TSK 0
I20260811 04:53:00.862018 10431 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 04:53:00.876327 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10342
2026-08-11T04:53:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1470 ms)
[----------] 18 tests from AuthTokenIssuingTest (26539 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:53:00 dist-test-slave-njxd krb5kdc[10446](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:53:00 dist-test-slave-njxd krb5kdc[10446](info): set up 2 sockets
Aug 11 04:53:00 dist-test-slave-njxd krb5kdc[10446](info): commencing operation
krb5kdc: starting...
W20260811 04:53:01.959599 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:53:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:53:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:53:02.084962 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:45175
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:53:02.194372 10463 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:02.194763 10463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:02.194834 10463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:02.194914 10463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:53:02.198974 10463 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:02.199056 10463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:02.199092 10463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:02.199149 10463 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:02.199190 10463 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:02.204466 10463 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:45175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10463
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:02.205646 10463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:02.206692 10463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:53:02.215247 10468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:02.215257 10471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:02.215282 10463 server_base.cc:1034] running on GCE node
W20260811 04:53:02.215255 10469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:02.216130 10463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:02.217200 10463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:02.218396 10463 hybrid_clock.cc:648] HybridClock initialized: now 1786423982218384 us; error 30 us; skew 500 ppm
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:02.221252 10463 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:53:02.222244 10463 webserver.cc:460] Webserver started at http://127.17.188.126:39403/ using document root <none> and password file <none>
I20260811 04:53:02.222826 10463 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:02.222918 10463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:02.223155 10463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:02.225189 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "3d9372b191f34e06873c4495d8966be6"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "c65f2a1703d0cc854a37a8e4479e9a4a"
server_key_iv: "6e8d4be882d02dc29bd5e03be524747d"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.225845 10463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "3d9372b191f34e06873c4495d8966be6"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "c65f2a1703d0cc854a37a8e4479e9a4a"
server_key_iv: "6e8d4be882d02dc29bd5e03be524747d"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.229550 10463 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260811 04:53:02.231956 10478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:02.233148 10463 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260811 04:53:02.233290 10463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "3d9372b191f34e06873c4495d8966be6"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "c65f2a1703d0cc854a37a8e4479e9a4a"
server_key_iv: "6e8d4be882d02dc29bd5e03be524747d"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.233399 10463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:02.274237 10463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:02.277760 10463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:02.277992 10463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:02.285207 10463 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:45175
I20260811 04:53:02.285506 10532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:45175 every 8 connection(s)
I20260811 04:53:02.286237 10463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:53:02.289079 10533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:02.291638 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10463
I20260811 04:53:02.291800 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:53:02.292078 18161 external_mini_cluster.cc:1428] Setting key ec75003d29fae6af601d82ce6db4b060
I20260811 04:53:02.292987 10533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.188.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.125@KRBTEST.COM" created.
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:02.311127 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.295364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:45175 (local address 127.0.0.1:36090)
0811 04:53:02.295914 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.295969 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.297241 (+ 1272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.298112 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.298120 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.298644 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.299058 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.299079 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.300882 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.300887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.301801 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.301813 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.302530 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.302533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.302628 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.303310 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.303328 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.305765 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.308141 (+ 2376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.308149 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.308157 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.308398 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.308789 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.308792 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.308793 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.308904 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.309745 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.309751 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.309876 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.310015 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.310274 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":128,"threads_started":1}
I20260811 04:53:02.311131 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.295364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.17.188.126:45175)
0811 04:53:02.295931 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.295947 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.296089 (+ 142us) server_negotiation.cc:407] Connection header received
0811 04:53:02.297624 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.297630 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.297869 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.298083 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.299242 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.300665 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.301920 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.302383 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.302507 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.305926 (+ 3419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.305932 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.305942 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.305963 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.307950 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.308532 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.308541 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.308546 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.308689 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.309001 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.309007 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.309012 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.309615 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.309759 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.310134 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.310391 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":451,"spinlock_wait_cycles":18176,"thread_start_us":185,"threads_started":1}
I20260811 04:53:02.313838 10533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.314680 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.314321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41724)
0811 04:53:02.314445 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.314527 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260811 04:53:02.314927 10482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
I20260811 04:53:02.315877 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.315556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41736)
0811 04:53:02.315679 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.315817 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260811 04:53:02.316119 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:42773: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
I20260811 04:53:02.322743 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:42773
--webserver_interface=127.17.188.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:53:02.365387 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } attempt: 1
I20260811 04:53:02.366366 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.366061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41752)
0811 04:53:02.366216 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.366282 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 04:53:02.367098 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.366893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41766)
0811 04:53:02.366996 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.367046 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 04:53:02.367226 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:42773: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
W20260811 04:53:02.433362 10540 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:02.433701 10540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:02.433769 10540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:02.433842 10540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 04:53:02.435391 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } attempt: 2
I20260811 04:53:02.436272 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.435919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41774)
0811 04:53:02.436094 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.436181 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 04:53:02.437019 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.436793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41790)
0811 04:53:02.436904 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.436952 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 04:53:02.437184 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:42773: Network error: Client connection negotiation failed: client connection to 127.17.188.125:42773: connect: Connection refused (error 111)
W20260811 04:53:02.438180 10540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:02.438263 10540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:02.438309 10540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:02.438349 10540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:02.438381 10540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:02.443682 10540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:42773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.188.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:02.444702 10540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:02.445694 10540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:53:02.454247 10546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:02.454252 10548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:02.454279 10545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:02.454437 10540 server_base.cc:1034] running on GCE node
I20260811 04:53:02.455202 10540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:02.456303 10540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:02.457505 10540 hybrid_clock.cc:648] HybridClock initialized: now 1786423982457488 us; error 28 us; skew 500 ppm
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:02.460223 10540 init.cc:377] Logged in from keytab as kudu/127.17.188.125@KRBTEST.COM (short username kudu)
I20260811 04:53:02.461088 10540 webserver.cc:460] Webserver started at http://127.17.188.125:36221/ using document root <none> and password file <none>
I20260811 04:53:02.461694 10540 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:02.461783 10540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:02.462001 10540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:02.463985 10540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data/instance:
uuid: "d09245796efc416193cadc485efc49fa"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "4c0efc0ab122a5dee9db0335a12f7613"
server_key_iv: "6ac634452cff97481d234bf07eeda1e9"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.464551 10540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal/instance:
uuid: "d09245796efc416193cadc485efc49fa"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "4c0efc0ab122a5dee9db0335a12f7613"
server_key_iv: "6ac634452cff97481d234bf07eeda1e9"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.468091 10540 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260811 04:53:02.470480 10557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:02.471612 10540 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:53:02.471750 10540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "d09245796efc416193cadc485efc49fa"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "4c0efc0ab122a5dee9db0335a12f7613"
server_key_iv: "6ac634452cff97481d234bf07eeda1e9"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.471853 10540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:02.481648 10540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:02.484403 10540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:02.484593 10540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:02.491675 10540 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.125:42773
I20260811 04:53:02.491977 10612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.125:42773 every 8 connection(s)
I20260811 04:53:02.492630 10540 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
I20260811 04:53:02.495455 10613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:02.499449 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10540
I20260811 04:53:02.499586 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-1/wal/instance
I20260811 04:53:02.499285 10613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.499910 18161 external_mini_cluster.cc:1428] Setting key 6624d6209b088ff4c3f1291f8b055c39
WARNING: no policy specified for kudu/127.17.188.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.124@KRBTEST.COM" created.
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:02.517757 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.501420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36098 (local address 127.17.188.126:45175)
0811 04:53:02.501576 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.501582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.502702 (+ 1120us) server_negotiation.cc:407] Connection header received
0811 04:53:02.504087 (+ 1385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.504090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.504146 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.504211 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.505922 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.506449 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.508213 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.508639 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.508776 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.514041 (+ 5265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.514044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.514047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.514074 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.515604 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.516138 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.516146 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.516148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.516225 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.516578 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.516583 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.516589 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.516769 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.516876 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.517410 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.517540 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:53:02.518560 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.501911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:45175 (local address 127.0.0.1:36098)
0811 04:53:02.502500 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.502564 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.503840 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.504414 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.504426 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.504974 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.505739 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.505760 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.506586 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.506592 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.508081 (+ 1489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.508096 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.508846 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.508880 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.509152 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.509877 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.509893 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.513844 (+ 3951us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.515732 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.515739 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.515756 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.516020 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.516319 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.516323 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.516325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.516470 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.516877 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.516884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.517152 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.517339 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.517691 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":154,"threads_started":1}
I20260811 04:53:02.519961 10613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
I20260811 04:53:02.528331 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } attempt: 3
I20260811 04:53:02.528987 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:34779
--webserver_interface=127.17.188.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:44521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:53:02.530337 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.520534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41802)
0811 04:53:02.520750 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.520767 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.520845 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.521294 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.521298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.521479 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.521568 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.521629 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.522790 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.522793 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.523519 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.523529 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.524203 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.524207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.524277 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.524763 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.524774 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.526113 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.528199 (+ 2086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.528205 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.528208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.528473 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.528809 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.528812 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.528813 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.528894 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.529665 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.529671 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.529780 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.529898 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.530052 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 04:53:02.530364 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.520632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41802 (local address 127.17.188.125:42773)
0811 04:53:02.520946 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.520955 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.520974 (+ 19us) server_negotiation.cc:407] Connection header received
0811 04:53:02.521008 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.521012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.521161 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.521266 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.521737 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.522685 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.523629 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.524104 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.524189 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.526283 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.526291 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.526303 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.526323 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.528070 (+ 1747us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.528603 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.528609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.528611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.528703 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.528989 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.528992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.528994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.529462 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.529623 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.530017 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.530163 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":140,"threads_started":1}
I20260811 04:53:02.532226 10613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.533063 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.532660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55220)
0811 04:53:02.532882 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.532973 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
W20260811 04:53:02.533268 10560 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
I20260811 04:53:02.534420 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.534091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55232)
0811 04:53:02.534262 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.534329 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
W20260811 04:53:02.534572 10613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:53:02.539600 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.528986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41804 (local address 127.17.188.125:42773)
0811 04:53:02.529339 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.529347 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.529359 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:53:02.529392 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.529395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.529439 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.529538 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.529981 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.531138 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.532791 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.533625 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.534155 (+ 530us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.536318 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.536322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.536324 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.536344 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.537902 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.538422 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.538425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.538426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.538497 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.538809 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.538811 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.538812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.538970 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.539044 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.539396 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.539487 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":115,"threads_started":1}
I20260811 04:53:02.539747 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.528794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41804)
0811 04:53:02.528901 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.528917 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.528995 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.529563 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.529566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.529757 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.529839 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.529844 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.531276 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.531282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.532663 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.532676 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.533786 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.533790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.533900 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.534413 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.534427 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.536111 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.538010 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.538016 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.538020 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.538320 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.538594 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.538598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.538600 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.538709 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.539069 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.539074 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.539216 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.539350 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.539518 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 04:53:02.540537 10533 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.541265 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.541040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55234)
0811 04:53:02.541156 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.541201 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 04:53:02.542148 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.541907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55236)
0811 04:53:02.542057 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.542098 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260811 04:53:02.542277 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
I20260811 04:53:02.573443 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 1
I20260811 04:53:02.574354 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.574023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55242)
0811 04:53:02.574176 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.574246 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 04:53:02.575103 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.574888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55244)
0811 04:53:02.574995 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.575041 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 04:53:02.575232 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
I20260811 04:53:02.583909 10613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 1
I20260811 04:53:02.584728 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.584453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55250)
0811 04:53:02.584595 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.584652 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 04:53:02.585503 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.585306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55266)
0811 04:53:02.585408 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.585451 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 04:53:02.585749 10613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
W20260811 04:53:02.647588 10620 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:02.647964 10620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:02.648037 10620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:02.648119 10620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 04:53:02.650426 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 2
I20260811 04:53:02.651304 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.650995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55280)
0811 04:53:02.651148 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.651228 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 04:53:02.652043 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.651833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55282)
0811 04:53:02.651939 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.651986 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 04:53:02.652194 10533 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
W20260811 04:53:02.652645 10620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:02.652702 10620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:02.652742 10620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:02.652799 10620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:02.652849 10620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:02.653895 10613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 2
I20260811 04:53:02.654592 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.654334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55292)
0811 04:53:02.654467 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.654516 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 04:53:02.655304 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.655118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55296)
0811 04:53:02.655216 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.655258 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 04:53:02.655488 10613 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:34779: Network error: Client connection negotiation failed: client connection to 127.17.188.124:34779: connect: Connection refused (error 111)
I20260811 04:53:02.658875 10620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:44521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:45175,127.17.188.125:42773,127.17.188.124:34779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:34779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.188.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:02.659958 10620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:02.660987 10620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:53:02.669451 10629 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:02.669528 10626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:02.669476 10627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:02.669821 10620 server_base.cc:1034] running on GCE node
I20260811 04:53:02.670348 10620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:02.671370 10620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:02.672576 10620 hybrid_clock.cc:648] HybridClock initialized: now 1786423982672560 us; error 30 us; skew 500 ppm
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:02.675311 10620 init.cc:377] Logged in from keytab as kudu/127.17.188.124@KRBTEST.COM (short username kudu)
I20260811 04:53:02.676287 10620 webserver.cc:460] Webserver started at http://127.17.188.124:34169/ using document root <none> and password file <none>
I20260811 04:53:02.676849 10620 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:02.676944 10620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:02.677181 10620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:02.679273 10620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data/instance:
uuid: "5bf324740dd04c6eb9a14f52f525f54b"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "8182f4f1b4f6c503f53989d5e7ce52ec"
server_key_iv: "ce40699994a45cb4c7b8b4bc2cfb9e61"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.679842 10620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal/instance:
uuid: "5bf324740dd04c6eb9a14f52f525f54b"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "8182f4f1b4f6c503f53989d5e7ce52ec"
server_key_iv: "ce40699994a45cb4c7b8b4bc2cfb9e61"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.683709 10620 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 04:53:02.686174 10637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:02.687332 10620 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 04:53:02.687477 10620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "5bf324740dd04c6eb9a14f52f525f54b"
format_stamp: "Formatted at 2026-08-11 04:53:02 on dist-test-slave-njxd"
server_key: "8182f4f1b4f6c503f53989d5e7ce52ec"
server_key_iv: "ce40699994a45cb4c7b8b4bc2cfb9e61"
server_key_version: "encryptionkey@0"
I20260811 04:53:02.687587 10620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:02.698169 10620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:02.700947 10620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:02.701143 10620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:02.708379 10620 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.124:34779
I20260811 04:53:02.708706 10695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.124:34779 every 8 connection(s)
I20260811 04:53:02.709399 10620 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
I20260811 04:53:02.712132 10696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:02.715735 10696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.717856 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10620
I20260811 04:53:02.717991 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786423695299078-18161-0/minicluster-data/master-2/wal/instance
I20260811 04:53:02.718315 18161 external_mini_cluster.cc:1428] Setting key aba8dedb9edcef29df13a3ffcde478c6
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:53:02.729347 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.717485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36112 (local address 127.17.188.126:45175)
0811 04:53:02.717673 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.717677 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.718649 (+ 972us) server_negotiation.cc:407] Connection header received
0811 04:53:02.719824 (+ 1175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.719828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.719884 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.719993 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.720762 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.721290 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.722333 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.722551 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.722662 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.725358 (+ 2696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.725362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.725365 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.725399 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.727110 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.727659 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.727664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.727665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.727752 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.728100 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.728104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.728105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.728306 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.728418 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.729049 (+ 631us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.729187 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 04:53:02.730099 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.718949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55310 (local address 127.17.188.124:34779)
0811 04:53:02.719376 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.719383 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.719419 (+ 36us) server_negotiation.cc:407] Connection header received
0811 04:53:02.719608 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.719621 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.719816 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.720017 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.720873 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.721794 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.722637 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.723052 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.723172 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.725845 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.725851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.725861 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.725882 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.727471 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.727936 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.727941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.727942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.728019 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.728297 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.728301 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.728303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.728644 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.728860 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.729060 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.729245 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":336,"thread_start_us":151,"threads_started":1}
I20260811 04:53:02.730099 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.717966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:45175 (local address 127.0.0.1:36112)
0811 04:53:02.718499 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.718542 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.719615 (+ 1073us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.720043 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.720048 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.720395 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.720625 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.720637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.721401 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.721406 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.722210 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.722219 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.722707 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.722711 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.722942 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.723537 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.723560 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.725177 (+ 1617us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.727236 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.727245 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.727255 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.727545 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.727847 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.727852 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.727854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.727995 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.728420 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.728429 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.728659 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.728838 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.729175 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"mutex_wait_us":47,"thread_start_us":128,"threads_started":1}
I20260811 04:53:02.731439 10696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:02.740319 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.731932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:42773 (local address 127.0.0.1:41810)
0811 04:53:02.732053 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.732067 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.732156 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.732582 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.732585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.732761 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.732879 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.732887 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.733672 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.733675 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.734203 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.734212 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.734693 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.734696 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.734794 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.735301 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.735313 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.736620 (+ 1307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.738650 (+ 2030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.738653 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.738655 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.738921 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.739239 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.739242 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.739243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.739339 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.739870 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.739875 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.739986 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.740104 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.740207 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 04:53:02.740471 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.732065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41810 (local address 127.17.188.125:42773)
0811 04:53:02.732321 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.732325 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.732337 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:53:02.732397 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.732400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.732460 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.732545 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.733004 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.733522 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.734323 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.734583 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.734665 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.736744 (+ 2079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.736747 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.736750 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.736775 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.738525 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.739041 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.739044 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.739046 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.739136 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.739441 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.739444 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.739445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.739741 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.739858 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.740178 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.740312 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173}
I20260811 04:53:02.741241 10696 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:02.742642 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.732690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36118 (local address 127.17.188.126:45175)
0811 04:53:02.732799 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.732803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.732815 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:53:02.732853 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.732857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.732896 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.732975 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.734244 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.734872 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.735870 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.736072 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.736203 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.739077 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.739083 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.739097 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.739122 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.740829 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.741330 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.741335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.741340 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.741430 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.741749 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.741752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.741754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.741986 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.742219 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.742356 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.742471 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:53:02.746659 10613 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 3
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:53:02.750110 10698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.741814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55324)
0811 04:53:02.741926 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.741939 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.742007 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.742292 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.742295 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.742453 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.742510 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.742514 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.743404 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.743409 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.744200 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.744214 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.744647 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.744651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.744740 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.745227 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.745242 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.746605 (+ 1363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.748487 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.748490 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.748492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.748733 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.749055 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.749058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.749060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.749161 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.749598 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.749605 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.749699 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.749809 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.749942 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 04:53:02.750613 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.742018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55324 (local address 127.17.188.124:34779)
0811 04:53:02.742123 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.742127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.742144 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:53:02.742169 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.742171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.742199 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.742281 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.742614 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.743289 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.744317 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.744535 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.744611 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.746729 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.746732 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.746734 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.746755 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.748363 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.748845 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.748848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.748851 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.748948 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.749271 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.749274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.749276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.749462 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.749555 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.750319 (+ 764us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.750447 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 04:53:02.751353 10533 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } attempt: 3
I20260811 04:53:02.754010 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.743842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41814 (local address 127.17.188.125:42773)
0811 04:53:02.743941 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.743944 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.743964 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:53:02.744020 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.744022 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.744054 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.744114 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.744792 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.745241 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.746211 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.746537 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.746681 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.749657 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.749661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.749663 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.749685 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.751694 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.752225 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.752228 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.752230 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.752311 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.752630 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.752634 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.752635 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.752855 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.753331 (+ 476us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.753761 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.753874 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 04:53:02.754292 10696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: Bootstrap starting.
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
Aug 11 04:53:02 dist-test-slave-njxd krb5kdc[10446](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423982, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:53:02.758490 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:53:02.758705 10696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:02.758911 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.747075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55340)
0811 04:53:02.747195 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.747220 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.747306 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.747820 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.747825 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.748024 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.748154 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.748163 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.749764 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.749767 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.750576 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.750592 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.752761 (+ 2169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.752765 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.752855 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.753292 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.753306 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.754716 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.756986 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.756990 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.756992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.757249 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.757790 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.757794 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.757795 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.757893 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.758376 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.758379 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.758477 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.758600 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.758751 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 04:53:02.759434 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.747150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55340 (local address 127.17.188.124:34779)
0811 04:53:02.747540 (+ 390us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.747549 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.747563 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:53:02.747612 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.747616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.747661 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.748283 (+ 622us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.748370 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.749653 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.752241 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.752608 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.753046 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.754852 (+ 1806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.754855 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.754857 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.754880 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.756845 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.757421 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.757423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.757425 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.757517 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.758022 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.758026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.758028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.758269 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.758384 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.758720 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.758869 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":119,"threads_started":1}
I20260811 04:53:02.759618 10696 log.cc:824] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:02.759887 10506 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3d9372b191f34e06873c4495d8966be6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36118
I20260811 04:53:02.762024 10696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: No bootstrap required, opened a new log
I20260811 04:53:02.762404 10613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: Bootstrap starting.
I20260811 04:53:02.762864 10536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.751781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:34779 (local address 127.0.0.1:55348)
0811 04:53:02.751968 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:02.751982 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:02.752077 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:02.752356 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:02.752359 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:02.752531 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:02.752630 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.752640 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.753678 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.753682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.754568 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:02.754579 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.755346 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.755349 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:02.755440 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.755824 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:02.755842 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:02.757260 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:02.759860 (+ 2600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.759867 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.759871 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.761487 (+ 1616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.761819 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:02.761822 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:02.761824 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:02.761917 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:02.762389 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:02.762392 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:02.762482 (+ 90us) client_negotiation.cc:769] Sending connection context
0811 04:53:02.762587 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 04:53:02.762722 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105}
I20260811 04:53:02.762876 10700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.751839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55348 (local address 127.17.188.124:34779)
0811 04:53:02.751945 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.751949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.752052 (+ 103us) server_negotiation.cc:407] Connection header received
0811 04:53:02.752170 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.752175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.752231 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.752740 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.752818 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.753516 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.754830 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.755170 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.755339 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.757402 (+ 2063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.757406 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.757411 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.757434 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.759737 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.761616 (+ 1879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.761622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.761626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.761709 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.762015 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.762017 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.762019 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.762241 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.762324 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.762654 (+ 330us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.762758 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 04:53:02.764905 10613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:02.765095 10696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.765323 10696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf324740dd04c6eb9a14f52f525f54b, State: Initialized, Role: FOLLOWER
I20260811 04:53:02.765722 10613 log.cc:824] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:02.765676 10696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.766145 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.766275 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.767050 10696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:02.768194 10613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: No bootstrap required, opened a new log
I20260811 04:53:02.768774 10533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: Bootstrap starting.
I20260811 04:53:02.771170 10533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:02.771996 10533 log.cc:824] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:02.772461 10613 raft_consensus.cc:348] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.772692 10613 raft_consensus.cc:729] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d09245796efc416193cadc485efc49fa, State: Initialized, Role: FOLLOWER
I20260811 04:53:02.773003 10613 consensus_queue.cc:260] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.774092 10533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: No bootstrap required, opened a new log
I20260811 04:53:02.774351 10613 sys_catalog.cc:564] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:02.776959 10533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.773933 10620 master_runner.cc:186] Error getting master registration for 127.17.188.126:45175: OK, instance_id { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" instance_seqno: 1786423982283240 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:53:02.777179 10533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d9372b191f34e06873c4495d8966be6, State: Initialized, Role: FOLLOWER
I20260811 04:53:02.777276 10620 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260811 04:53:02.772342 10716 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:02.777490 10716 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:02.777467 10533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
W20260811 04:53:02.781759 10730 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:02.781836 10730 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:02.782016 10719 sys_catalog.cc:455] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.782145 10719 sys_catalog.cc:458] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.778859 10533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:02.778910 10506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
W20260811 04:53:02.779572 10484 tablet.cc:2369] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 04:53:02.784409 10506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:02.778337 10540 master_runner.cc:186] Error getting master registration for 127.17.188.126:45175: OK, instance_id { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" instance_seqno: 1786423982283240 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:53:02.785730 10506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.785905 10540 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 04:53:02.778311 10731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.786129 10731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.786708 10506 leader_election.cc:288] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [CANDIDATE]: Term 1 election: Requested vote from peers d09245796efc416193cadc485efc49fa (127.17.188.125:42773), 5bf324740dd04c6eb9a14f52f525f54b (127.17.188.124:34779)
I20260811 04:53:02.787563 10669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d9372b191f34e06873c4495d8966be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5bf324740dd04c6eb9a14f52f525f54b"
I20260811 04:53:02.787796 10669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:02.787940 10584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d9372b191f34e06873c4495d8966be6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d09245796efc416193cadc485efc49fa"
I20260811 04:53:02.788185 10584 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:02.789202 10669 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d9372b191f34e06873c4495d8966be6 in term 1.
I20260811 04:53:02.789769 10481 leader_election.cc:302] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d9372b191f34e06873c4495d8966be6, 5bf324740dd04c6eb9a14f52f525f54b; no voters:
I20260811 04:53:02.790117 10731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:53:02.790809 10731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [term 1 LEADER]: Becoming Leader. State: Replica: 3d9372b191f34e06873c4495d8966be6, State: Running, Role: LEADER
I20260811 04:53:02.791209 10731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } }
I20260811 04:53:02.791323 10584 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d9372b191f34e06873c4495d8966be6 in term 1.
I20260811 04:53:02.793874 10731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d9372b191f34e06873c4495d8966be6. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.795696 10731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: This master's current role is: LEADER
W20260811 04:53:02.811182 10755 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:02.811298 10755 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:02.811600 10757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 04:53:02.812516 10757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:53:02.822253 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.792362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41824 (local address 127.17.188.125:42773)
0811 04:53:02.792480 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.792484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.794745 (+ 2261us) server_negotiation.cc:407] Connection header received
0811 04:53:02.795244 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.795248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.795297 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.795348 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.800791 (+ 5443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.801533 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.806186 (+ 4653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.806529 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.806604 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.811648 (+ 5044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.811652 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.811655 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.811684 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.813648 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.818764 (+ 5116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.818768 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.818770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.818857 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.819531 (+ 674us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.819534 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.819536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.819755 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.819897 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.821951 (+ 2054us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.822079 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 04:53:02.824131 10701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.793755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55362 (local address 127.17.188.124:34779)
0811 04:53:02.793871 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.793875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.797609 (+ 3734us) server_negotiation.cc:407] Connection header received
0811 04:53:02.797782 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.797785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.797833 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.797883 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.802188 (+ 4305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.802970 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.807257 (+ 4287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.807631 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.807708 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.816119 (+ 8411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.816123 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.816126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.816155 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.817864 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.819156 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.819160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.819162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.819245 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.820622 (+ 1377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.820625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.820627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.820838 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.820946 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.823838 (+ 2892us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.823967 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:53:02.825181 10669 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [term 1 FOLLOWER]: Refusing update from remote peer 3d9372b191f34e06873c4495d8966be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:53:02.825547 10537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:02.793092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36126 (local address 127.17.188.126:45175)
0811 04:53:02.793209 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.793213 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.794960 (+ 1747us) server_negotiation.cc:407] Connection header received
0811 04:53:02.795482 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.795486 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.795534 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.795582 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.798741 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.799544 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.804958 (+ 5414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:02.805321 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:02.805398 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:02.814198 (+ 8800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:02.814202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:02.814205 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:02.814232 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:02.815929 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.819974 (+ 4045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.819978 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.819980 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.820059 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:02.821256 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:02.821260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:02.821262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:02.821475 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:02.821615 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:02.825266 (+ 3651us) server_negotiation.cc:299] Negotiation successful
0811 04:53:02.825402 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:53:02.825953 10731 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:53:02.830272 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d9372b191f34e06873c4495d8966be6. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.830408 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.831352 10584 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [term 1 FOLLOWER]: Refusing update from remote peer 3d9372b191f34e06873c4495d8966be6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:53:02.831956 10731 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:53:02.836424 10719 sys_catalog.cc:455] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d9372b191f34e06873c4495d8966be6. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.836536 10719 sys_catalog.cc:458] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.837972 10751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.838093 10751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:02.838421 10759 mvcc.cc:205] Tried to move back new op lower bound from 7317192633643855872 to 7317192633517252608. Current Snapshot: MvccSnapshot[applied={T|T < 7317192633643855872}]
I20260811 04:53:02.838419 10703 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.838534 10703 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.838897 10760 mvcc.cc:205] Tried to move back new op lower bound from 7317192633643855872 to 7317192633517252608. Current Snapshot: MvccSnapshot[applied={T|T < 7317192633643855872}]
I20260811 04:53:02.847450 10731 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.847570 10731 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6 [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:02.848591 10719 sys_catalog.cc:455] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d9372b191f34e06873c4495d8966be6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d9372b191f34e06873c4495d8966be6" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 45175 } } peers { permanent_uuid: "d09245796efc416193cadc485efc49fa" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 42773 } } peers { permanent_uuid: "5bf324740dd04c6eb9a14f52f525f54b" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 34779 } } }
I20260811 04:53:02.848694 10719 sys_catalog.cc:458] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:02.848945 10763 mvcc.cc:205] Tried to move back new op lower bound from 7317192633643855872 to 7317192633517252608. Current Snapshot: MvccSnapshot[applied={T|T < 7317192633643855872}]
I20260811 04:53:02.849484 10757 catalog_manager.cc:1347] Generated new cluster ID: 10dcc7bde42149c6aedf135dcb3d50a9
I20260811 04:53:02.849550 10757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:53:02.881265 10757 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:53:02.882526 10757 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:53:02.893935 10757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d9372b191f34e06873c4495d8966be6: Generated new TSK 0
I20260811 04:53:02.894755 10757 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:53:02.932699 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.929611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41826 (local address 127.17.188.125:42773)
0811 04:53:02.929750 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.929754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.931644 (+ 1890us) server_negotiation.cc:407] Connection header received
0811 04:53:02.931838 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.931842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.931901 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.931951 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.932566 (+ 615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41826: BlockingRecv error: recv got EOF from 127.0.0.1:41826 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 04:53:02.934334 10537 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.930437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36130 (local address 127.17.188.126:45175)
0811 04:53:02.930577 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.930581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.933214 (+ 2633us) server_negotiation.cc:407] Connection header received
0811 04:53:02.933680 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.933683 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.933730 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.933778 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.934223 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36130: BlockingRecv error: recv got EOF from 127.0.0.1:36130 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 04:53:02.935411 10701 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.931105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55378 (local address 127.17.188.124:34779)
0811 04:53:02.931248 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.931253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.933399 (+ 2146us) server_negotiation.cc:407] Connection header received
0811 04:53:02.934620 (+ 1221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.934624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.934675 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.934728 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.935286 (+ 558us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55378: BlockingRecv error: recv got EOF from 127.0.0.1:55378 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 04:53:02.940117 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.938540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41838 (local address 127.17.188.125:42773)
0811 04:53:02.938652 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.938656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.939161 (+ 505us) server_negotiation.cc:407] Connection header received
0811 04:53:02.939378 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.939382 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.939454 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.939506 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.940014 (+ 508us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41838: BlockingRecv error: recv got EOF from 127.0.0.1:41838 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 04:53:02.945267 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.943593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41844 (local address 127.17.188.125:42773)
0811 04:53:02.943703 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.943707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.944287 (+ 580us) server_negotiation.cc:407] Connection header received
0811 04:53:02.944481 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.944485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.944536 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.944602 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.945163 (+ 561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41844: BlockingRecv error: recv got EOF from 127.0.0.1:41844 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 04:53:02.950938 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.949415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41858 (local address 127.17.188.125:42773)
0811 04:53:02.949517 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.949521 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.950048 (+ 527us) server_negotiation.cc:407] Connection header received
0811 04:53:02.950237 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.950240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.950286 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.950335 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.950832 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41858: BlockingRecv error: recv got EOF from 127.0.0.1:41858 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 04:53:02.959317 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.957229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41870 (local address 127.17.188.125:42773)
0811 04:53:02.957374 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.957378 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.958038 (+ 660us) server_negotiation.cc:407] Connection header received
0811 04:53:02.958283 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.958287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.958341 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.958395 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.958971 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41870: BlockingRecv error: recv got EOF from 127.0.0.1:41870 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 04:53:02.971484 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.969693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41880 (local address 127.17.188.125:42773)
0811 04:53:02.969809 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.969813 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.970448 (+ 635us) server_negotiation.cc:407] Connection header received
0811 04:53:02.970665 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.970669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.970724 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.970781 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.971373 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41880: BlockingRecv error: recv got EOF from 127.0.0.1:41880 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:53:02.991250 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:02.989772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.17.188.125:42773)
0811 04:53:02.989881 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:02.989885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:02.990276 (+ 391us) server_negotiation.cc:407] Connection header received
0811 04:53:02.990403 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:02.990406 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:02.990486 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:02.990612 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:02.991134 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41894: BlockingRecv error: recv got EOF from 127.0.0.1:41894 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260811 04:53:03.026379 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:03.025191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41910 (local address 127.17.188.125:42773)
0811 04:53:03.025389 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:03.025393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:03.025475 (+ 82us) server_negotiation.cc:407] Connection header received
0811 04:53:03.025633 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:03.025636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:03.025685 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:03.025761 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:03.026228 (+ 467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41910: BlockingRecv error: recv got EOF from 127.0.0.1:41910 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
W20260811 04:53:03.093765 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:03.092595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41926 (local address 127.17.188.125:42773)
0811 04:53:03.092753 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:03.092757 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:03.092875 (+ 118us) server_negotiation.cc:407] Connection header received
0811 04:53:03.093005 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:03.093008 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:03.093067 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:03.093154 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:03.093632 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41926: BlockingRecv error: recv got EOF from 127.0.0.1:41926 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 04:53:03.225344 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:03.224023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41932 (local address 127.17.188.125:42773)
0811 04:53:03.224195 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:03.224201 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:03.224344 (+ 143us) server_negotiation.cc:407] Connection header received
0811 04:53:03.224536 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:03.224540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:03.224621 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:03.224722 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:03.225219 (+ 497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41932: BlockingRecv error: recv got EOF from 127.0.0.1:41932 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 04:53:03.484954 10619 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:03.483632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41940 (local address 127.17.188.125:42773)
0811 04:53:03.483794 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:03.483798 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:03.483912 (+ 114us) server_negotiation.cc:407] Connection header received
0811 04:53:03.484056 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:03.484058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:03.484122 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:03.484197 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:03.484817 (+ 620us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41940: BlockingRecv error: recv got EOF from 127.0.0.1:41940 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 04:53:03.778986 10716 catalog_manager.cc:1259] Loaded cluster ID: 10dcc7bde42149c6aedf135dcb3d50a9
I20260811 04:53:03.779079 10716 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: loading cluster ID for follower catalog manager: success
I20260811 04:53:03.780778 10716 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: acquiring CA information for follower catalog manager: success
I20260811 04:53:03.782073 10716 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5bf324740dd04c6eb9a14f52f525f54b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:53:03.783121 10730 catalog_manager.cc:1259] Loaded cluster ID: 10dcc7bde42149c6aedf135dcb3d50a9
I20260811 04:53:03.783176 10730 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: loading cluster ID for follower catalog manager: success
I20260811 04:53:03.784803 10730 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: acquiring CA information for follower catalog manager: success
I20260811 04:53:03.785992 10730 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d09245796efc416193cadc485efc49fa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:53:04.002753 10843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:03.998909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41944 (local address 127.17.188.125:42773)
0811 04:53:03.999144 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:03.999148 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:03.999216 (+ 68us) server_negotiation.cc:407] Connection header received
0811 04:53:03.999342 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:03.999345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:03.999470 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:03.999617 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:03.999830 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.000317 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.001148 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.001381 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.001491 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:04.001909 (+ 418us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:04.002360 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:04.002460 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:04.002519 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 04:53:04.002578 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":94,"threads_started":1}
I20260811 04:53:04.009449 10849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:04.005976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55392 (local address 127.17.188.124:34779)
0811 04:53:04.006275 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:04.006279 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:04.006293 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:53:04.006404 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:04.006406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:04.006515 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:04.006607 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:04.006806 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.007310 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.008056 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.008269 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.008333 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:04.008632 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:04.009000 (+ 368us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:04.009084 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:04.009215 (+ 131us) server_negotiation.cc:299] Negotiation successful
0811 04:53:04.009259 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":225,"thread_start_us":88,"threads_started":1}
I20260811 04:53:04.016796 10849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:04.012827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55402 (local address 127.17.188.124:34779)
0811 04:53:04.012953 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:04.012958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:04.013203 (+ 245us) server_negotiation.cc:407] Connection header received
0811 04:53:04.013405 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:04.013408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:04.013458 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:04.013527 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:04.013893 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.014671 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.015571 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.015880 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.015972 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:04.016329 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:04.016405 (+ 76us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:04.016487 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:04.016597 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 04:53:04.016645 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 04:53:04.016866 10843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:04.012449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41956 (local address 127.17.188.125:42773)
0811 04:53:04.012605 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:04.012612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:04.013164 (+ 552us) server_negotiation.cc:407] Connection header received
0811 04:53:04.013273 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:04.013278 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:04.013332 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:04.013399 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:04.013774 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.014562 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.015641 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.015976 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.016081 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:04.016377 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:04.016446 (+ 69us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:04.016491 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:04.016666 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 04:53:04.016725 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 04:53:04.017166 10856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:04.012417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.17.188.126:45175)
0811 04:53:04.012716 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:04.012722 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:04.012851 (+ 129us) server_negotiation.cc:407] Connection header received
0811 04:53:04.013025 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:04.013029 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:04.013196 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:04.013304 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:04.013525 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.014323 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.015511 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:04.015809 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:04.015918 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:04.016273 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:04.016596 (+ 323us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:04.016676 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:04.016963 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 04:53:04.017026 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":93,"threads_started":1}
I20260811 04:53:04.020056 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10463
I20260811 04:53:04.029795 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10540
I20260811 04:53:04.037506 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10620
2026-08-11T04:53:04Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3162 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 04:53:04 dist-test-slave-njxd krb5kdc[10860](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 04:53:04 dist-test-slave-njxd krb5kdc[10860](info): set up 2 sockets
Aug 11 04:53:04 dist-test-slave-njxd krb5kdc[10860](info): commencing operation
krb5kdc: starting...
W20260811 04:53:05.130115 18161 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/test-user.keytab.
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T04:53:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T04:53:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.17.188.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
Entry for principal kudu/127.17.188.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab.
I20260811 04:53:05.256304 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41551
--webserver_interface=127.17.188.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:34977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 04:53:05.368549 10873 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:05.368883 10873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:05.368952 10873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:05.369031 10873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:53:05.372977 10873 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:05.373062 10873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:05.373108 10873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:05.373157 10873 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:05.373194 10873 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:05.378358 10873 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.126.keytab
--principal=kudu/127.17.188.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.126:41551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.17.188.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:05.379433 10873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:05.380479 10873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:53:05.388995 10879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:05.389019 10881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:05.389075 10873 server_base.cc:1034] running on GCE node
W20260811 04:53:05.389019 10878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:05.389832 10873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:05.390961 10873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:05.392150 10873 hybrid_clock.cc:648] HybridClock initialized: now 1786423985392131 us; error 33 us; skew 500 ppm
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:05.395056 10873 init.cc:377] Logged in from keytab as kudu/127.17.188.126@KRBTEST.COM (short username kudu)
I20260811 04:53:05.395944 10873 webserver.cc:460] Webserver started at http://127.17.188.126:33627/ using document root <none> and password file <none>
I20260811 04:53:05.396471 10873 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:05.396530 10873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:05.396696 10873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:05.398809 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data/instance:
uuid: "9ff55d78685b48338d8b00db263e0c3a"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "6c1a0d956ef80ec185a681d64c2eb1ba"
server_key_iv: "d6129af8ae0f7029ea9fad044c77c72b"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.399346 10873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance:
uuid: "9ff55d78685b48338d8b00db263e0c3a"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "6c1a0d956ef80ec185a681d64c2eb1ba"
server_key_iv: "d6129af8ae0f7029ea9fad044c77c72b"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.403168 10873 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 04:53:05.405754 10888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:05.407027 10873 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 04:53:05.407155 10873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal
uuid: "9ff55d78685b48338d8b00db263e0c3a"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "6c1a0d956ef80ec185a681d64c2eb1ba"
server_key_iv: "d6129af8ae0f7029ea9fad044c77c72b"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.407263 10873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:05.439567 10873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:05.443250 10873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:05.443466 10873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:05.451121 10873 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.126:41551
I20260811 04:53:05.451422 10945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.126:41551 every 8 connection(s)
I20260811 04:53:05.452149 10873 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/data/info.pb
I20260811 04:53:05.452940 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10873
I20260811 04:53:05.453091 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-0/wal/instance
I20260811 04:53:05.453419 18161 external_mini_cluster.cc:1428] Setting key 463027bf44d224ebaf8cabfc66049b90
I20260811 04:53:05.455807 10946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:05.459857 10946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.188.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.125@KRBTEST.COM" created.
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:05.476553 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.462209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.0.0.1:34616)
0811 04:53:05.462709 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.462760 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.463759 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.464525 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.464530 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.464926 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.465259 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.465275 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.466477 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.466483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.467543 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.467553 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.468471 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.468474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.468550 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.469212 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.469229 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.471003 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.473402 (+ 2399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.473410 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.473419 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.473750 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.474144 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.474147 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.474148 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.474268 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.475006 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.475012 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.475236 (+ 224us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.475404 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.475808 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":130,"thread_start_us":139,"threads_started":1}
I20260811 04:53:05.476558 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.462209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34616 (local address 127.17.188.126:41551)
0811 04:53:05.462663 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.462679 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.462879 (+ 200us) server_negotiation.cc:407] Connection header received
0811 04:53:05.464036 (+ 1157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.464041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.464245 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.464404 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.465413 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.466348 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.467663 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.468324 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.468510 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.471164 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.471175 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.471192 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.471221 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.473285 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.473872 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.473881 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.473885 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.474032 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.474373 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.474379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.474383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.474890 (+ 507us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.475002 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.475496 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.475664 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":318,"thread_start_us":175,"threads_started":1}
I20260811 04:53:05.478948 10946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:05.479775 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.479446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44010)
0811 04:53:05.479634 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.479715 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 04:53:05.479979 10890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
I20260811 04:53:05.480839 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.480656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44026)
0811 04:53:05.480746 (+ 90us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.480789 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 04:53:05.480990 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:36843: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
Entry for principal kudu/127.17.188.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab.
I20260811 04:53:05.482786 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:36843
--webserver_interface=127.17.188.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:34977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:53:05.530277 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } attempt: 1
I20260811 04:53:05.531193 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.530887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44028)
0811 04:53:05.531041 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.531113 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 04:53:05.531953 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.531748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44042)
0811 04:53:05.531849 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.531901 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 04:53:05.532104 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:36843: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
W20260811 04:53:05.599695 10953 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:05.600031 10953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:05.600090 10953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:05.600167 10953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 04:53:05.600281 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } attempt: 2
I20260811 04:53:05.601150 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.600842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44046)
0811 04:53:05.600994 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.601069 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 04:53:05.601897 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.601686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44048)
0811 04:53:05.601787 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.601835 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 04:53:05.602036 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.125:36843: Network error: Client connection negotiation failed: client connection to 127.17.188.125:36843: connect: Connection refused (error 111)
W20260811 04:53:05.604521 10953 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:05.604568 10953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:05.604615 10953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:05.604662 10953 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:05.604710 10953 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:05.610157 10953 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.125.keytab
--principal=kudu/127.17.188.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.125:36843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.17.188.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:05.611238 10953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:05.612274 10953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 04:53:05.621369 10960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:05.621361 10958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:05.621361 10962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:05.621605 10953 server_base.cc:1034] running on GCE node
I20260811 04:53:05.622359 10953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:05.623533 10953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:05.624725 10953 hybrid_clock.cc:648] HybridClock initialized: now 1786423985624702 us; error 28 us; skew 500 ppm
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:05.627612 10953 init.cc:377] Logged in from keytab as kudu/127.17.188.125@KRBTEST.COM (short username kudu)
I20260811 04:53:05.628558 10953 webserver.cc:460] Webserver started at http://127.17.188.125:34265/ using document root <none> and password file <none>
I20260811 04:53:05.629104 10953 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:05.629166 10953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:05.629343 10953 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:05.631486 10953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data/instance:
uuid: "38f03508b6d840ffae7a8f3c91c05d94"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "a87e044c8d171cd0fbebbaf8ac76a943"
server_key_iv: "c5b5f3fc6d8bd71092809e7a97ac4ba4"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.632030 10953 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal/instance:
uuid: "38f03508b6d840ffae7a8f3c91c05d94"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "a87e044c8d171cd0fbebbaf8ac76a943"
server_key_iv: "c5b5f3fc6d8bd71092809e7a97ac4ba4"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.635950 10953 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:53:05.638638 10972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:05.639982 10953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 04:53:05.640131 10953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal
uuid: "38f03508b6d840ffae7a8f3c91c05d94"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "a87e044c8d171cd0fbebbaf8ac76a943"
server_key_iv: "c5b5f3fc6d8bd71092809e7a97ac4ba4"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.640249 10953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:05.658118 10953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:05.661093 10953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:05.661307 10953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:05.668525 10953 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.125:36843
I20260811 04:53:05.668799 11029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.125:36843 every 8 connection(s)
I20260811 04:53:05.669504 10953 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/data/info.pb
I20260811 04:53:05.669873 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 10953
I20260811 04:53:05.670006 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-1/wal/instance
I20260811 04:53:05.670321 18161 external_mini_cluster.cc:1428] Setting key 82542e66a73d36fad1c190d2865c8369
I20260811 04:53:05.672375 11030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:05.677814 11030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.17.188.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.17.188.124@KRBTEST.COM" created.
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:05.692009 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.680170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34630 (local address 127.17.188.126:41551)
0811 04:53:05.680350 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.680355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.681249 (+ 894us) server_negotiation.cc:407] Connection header received
0811 04:53:05.682260 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.682267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.682344 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.682452 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.683750 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.684593 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.685753 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.685990 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.686103 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.688467 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.688470 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.688472 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.688496 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.689988 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.690493 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.690497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.690499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.690580 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.690921 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.690926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.690927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.691115 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.691222 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.691694 (+ 472us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.691814 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 04:53:05.692771 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.680590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.0.0.1:34630)
0811 04:53:05.681050 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.681093 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.681978 (+ 885us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.682581 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.682587 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.682942 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.683598 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.683614 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.684725 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.684727 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.685567 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.685641 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.686145 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.686150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.686325 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.686907 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.686923 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.688304 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.690112 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.690117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.690132 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.690392 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.690670 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.690675 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.690677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.690828 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.691215 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.691221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.691459 (+ 238us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.691638 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.691978 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":124,"threads_started":1}
I20260811 04:53:05.693233 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } attempt: 3
I20260811 04:53:05.694130 11030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
Entry for principal kudu/127.17.188.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab.
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:53:05.700737 18161 external_mini_cluster.cc:1326] Running /tmp/dist-test-task9CJn4q/build/debug/bin/kudu
/tmp/dist-test-task9CJn4q/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:36687
--webserver_interface=127.17.188.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.17.188.84:34977
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 04:53:05.712898 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.694658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44064)
0811 04:53:05.694764 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.694775 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.694835 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.695362 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.695365 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.695531 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.695640 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.695651 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.696750 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.696753 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.697654 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.697661 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.698646 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.698648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.698713 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.699052 (+ 339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.699062 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.701965 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.711274 (+ 9309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711279 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.711282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.711523 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.711914 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711917 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.711919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.712007 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.712425 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.712428 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.712508 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.712598 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.712729 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 04:53:05.713223 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.693670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44050)
0811 04:53:05.693839 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.693850 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.693908 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.694912 (+ 1004us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.694918 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.695108 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.695210 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.695217 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.696625 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.696631 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.697475 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.697487 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.698325 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.698328 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.698462 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.698903 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.698921 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.700914 (+ 1993us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.711110 (+ 10196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711114 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.711117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.711389 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.711792 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.711801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.711901 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.712619 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.712622 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.712738 (+ 116us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.712865 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.713027 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 04:53:05.713644 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.694824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.17.188.125:36843)
0811 04:53:05.695160 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.695169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.695182 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:53:05.695222 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.695225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.695270 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.695353 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.695780 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.696653 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.697761 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.698204 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.698286 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.702152 (+ 3866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.702158 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.702162 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.702193 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.711161 (+ 8968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711622 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.711627 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.711629 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.711758 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.712108 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.712111 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.712113 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.712327 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.713188 (+ 861us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.713255 (+ 67us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.713426 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":275,"spinlock_wait_cycles":1280,"thread_start_us":141,"threads_started":1}
I20260811 04:53:05.713856 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.694174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44050 (local address 127.17.188.125:36843)
0811 04:53:05.694481 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.694495 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.694519 (+ 24us) server_negotiation.cc:407] Connection header received
0811 04:53:05.694577 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.694583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.694773 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.695034 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.695316 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.696464 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.697646 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.698205 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.698321 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.701071 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.701079 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.701089 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.701110 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.710996 (+ 9886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711523 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.711531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.711533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.711632 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.711996 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.712001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.712003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.712444 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.712662 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.713239 (+ 577us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.713523 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":136,"server-negotiator.queue_time_us":192,"spinlock_wait_cycles":1408,"thread_start_us":100,"threads_started":1}
I20260811 04:53:05.715574 11030 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:05.715605 10946 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:05.716295 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.716034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37314)
0811 04:53:05.716158 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.716236 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 04:53:05.716493 10977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.716537 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.716249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37330)
0811 04:53:05.716381 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.716445 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 04:53:05.717365 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.717165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37346)
0811 04:53:05.717260 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.717310 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 04:53:05.717531 11030 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.717648 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.717319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37350)
0811 04:53:05.717486 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.717540 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 04:53:05.717818 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.748996 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 1
I20260811 04:53:05.749838 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.749512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37364)
0811 04:53:05.749684 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.749750 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 04:53:05.750535 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.750325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37372)
0811 04:53:05.750431 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.750481 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 04:53:05.750659 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.766812 11030 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 1
I20260811 04:53:05.767699 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.767374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37380)
0811 04:53:05.767540 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.767610 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 04:53:05.768383 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.768163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37388)
0811 04:53:05.768271 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.768322 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 04:53:05.768507 11030 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
W20260811 04:53:05.816792 11038 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 04:53:05.817180 11038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 04:53:05.817229 11038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 04:53:05.817287 11038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 04:53:05.821313 11038 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 04:53:05.821373 11038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 04:53:05.821393 11038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 04:53:05.821408 11038 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 04:53:05.821422 11038 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 04:53:05.825804 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 2
I20260811 04:53:05.826622 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.826323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37390)
0811 04:53:05.826474 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.826543 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 04:53:05.826949 11038 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.17.188.84:34977
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.17.188.126:41551,127.17.188.125:36843,127.17.188.124:36687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/krb5kdc/kudu_127.17.188.124.keytab
--principal=kudu/127.17.188.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.17.188.124:36687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.17.188.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 03:56:35 UTC on ccycloud.quasar-iyycfb.root.comops.site
build id 4579566
I20260811 04:53:05.827394 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.827172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37392)
0811 04:53:05.827292 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.827343 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 04:53:05.827515 10946 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.828115 11038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 04:53:05.829129 11038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 04:53:05.836669 11030 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 2
W20260811 04:53:05.837339 11044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 04:53:05.837447 11047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:05.837565 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.837255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37402)
0811 04:53:05.837425 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.837484 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260811 04:53:05.837549 11045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 04:53:05.837762 11038 server_base.cc:1034] running on GCE node
I20260811 04:53:05.838333 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.838106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37418)
0811 04:53:05.838215 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.838260 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 04:53:05.838534 11030 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.17.188.124:36687: Network error: Client connection negotiation failed: client connection to 127.17.188.124:36687: connect: Connection refused (error 111)
I20260811 04:53:05.838572 11038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 04:53:05.839839 11038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 04:53:05.841004 11038 hybrid_clock.cc:648] HybridClock initialized: now 1786423985840989 us; error 24 us; skew 500 ppm
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 04:53:05.843843 11038 init.cc:377] Logged in from keytab as kudu/127.17.188.124@KRBTEST.COM (short username kudu)
I20260811 04:53:05.844796 11038 webserver.cc:460] Webserver started at http://127.17.188.124:38785/ using document root <none> and password file <none>
I20260811 04:53:05.845395 11038 fs_manager.cc:359] Metadata directory not provided
I20260811 04:53:05.845460 11038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 04:53:05.845693 11038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 04:53:05.847833 11038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data/instance:
uuid: "19516e0991264821b4d5f44c66535dec"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "b6ee6bbe53cafa67e0145696818a42c6"
server_key_iv: "0fb5fc1956d0c78ee40cbd0a509f9a02"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.848351 11038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal/instance:
uuid: "19516e0991264821b4d5f44c66535dec"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "b6ee6bbe53cafa67e0145696818a42c6"
server_key_iv: "0fb5fc1956d0c78ee40cbd0a509f9a02"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.852244 11038 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 04:53:05.854758 11054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 04:53:05.856038 11038 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 04:53:05.856184 11038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data,/tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal
uuid: "19516e0991264821b4d5f44c66535dec"
format_stamp: "Formatted at 2026-08-11 04:53:05 on dist-test-slave-njxd"
server_key: "b6ee6bbe53cafa67e0145696818a42c6"
server_key_iv: "0fb5fc1956d0c78ee40cbd0a509f9a02"
server_key_version: "encryptionkey@0"
I20260811 04:53:05.856299 11038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 04:53:05.886322 11038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 04:53:05.889309 11038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 04:53:05.889520 11038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 04:53:05.896489 11038 rpc_server.cc:307] RPC server started. Bound to: 127.17.188.124:36687
I20260811 04:53:05.896768 11115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.17.188.124:36687 every 8 connection(s)
I20260811 04:53:05.897544 11038 server_base.cc:1166] Dumped server information to /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/data/info.pb
I20260811 04:53:05.900218 11117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 04:53:05.903836 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:05.907754 18161 external_mini_cluster.cc:1388] Started /tmp/dist-test-task9CJn4q/build/debug/bin/kudu as pid 11038
I20260811 04:53:05.907888 18161 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task9CJn4q/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786423695299078-18161-0/minicluster-data/master-2/wal/instance
I20260811 04:53:05.908182 18161 external_mini_cluster.cc:1428] Setting key 9cc4419479e0d04dca3e7cbcaba068ec
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:53:05.918468 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.905782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34646 (local address 127.17.188.126:41551)
0811 04:53:05.905919 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.905923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.906766 (+ 843us) server_negotiation.cc:407] Connection header received
0811 04:53:05.907776 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.907779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.907847 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.907954 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.909390 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.910167 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.911687 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.911950 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.912093 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.914760 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.914766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.914773 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.914809 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.916255 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.916863 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.916867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.916869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.916958 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.917332 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.917334 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.917335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.917505 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.917636 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.918135 (+ 499us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.918273 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 04:53:05.919358 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.906103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.126:41551 (local address 127.0.0.1:34646)
0811 04:53:05.906624 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.906668 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.907530 (+ 862us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.908143 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.908150 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.908540 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.909153 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.909193 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.910293 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.910295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.911561 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.911571 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.912122 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.912127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.912293 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.912861 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.912877 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.914623 (+ 1746us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.916364 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.916376 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.916386 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.916731 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.917053 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.917060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.917062 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.917231 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.917612 (+ 381us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.917618 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.917880 (+ 262us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.918073 (+ 193us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.918354 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":128,"threads_started":1}
I20260811 04:53:05.919358 11121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.908806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37434 (local address 127.17.188.124:36687)
0811 04:53:05.909393 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.909411 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.909428 (+ 17us) server_negotiation.cc:407] Connection header received
0811 04:53:05.909462 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.909465 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.909657 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.909822 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.910629 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.911704 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.912562 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.912964 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.913045 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.915749 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.915757 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.915772 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.915800 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.917612 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.918000 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.918007 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.918012 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.918097 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.918388 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.918391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.918393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.918643 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.918845 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.919044 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.919169 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":136,"threads_started":1}
I20260811 04:53:05.920496 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
I20260811 04:53:05.926652 10946 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 3
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.126@KRBTEST.COM
I20260811 04:53:05.930141 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.921091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44078 (local address 127.17.188.125:36843)
0811 04:53:05.921249 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.921254 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.921268 (+ 14us) server_negotiation.cc:407] Connection header received
0811 04:53:05.921350 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.921356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.921408 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.921479 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.922021 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.922669 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.923492 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.923730 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.923809 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.925943 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.925949 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.925955 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.925991 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.927812 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.928794 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.928797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.928799 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.928886 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.929181 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.929184 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.929186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.929389 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.929463 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.929870 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.929990 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 04:53:05.930667 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.920983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.125:36843 (local address 127.0.0.1:44078)
0811 04:53:05.921137 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.921149 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.921260 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.921522 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.921541 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.921745 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.921860 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.921868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.922789 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.922793 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.923357 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.923369 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.923837 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.923841 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.923940 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.924377 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.924388 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.925760 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.928392 (+ 2632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.928394 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.928395 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.928674 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.928999 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.929002 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.929004 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.929088 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.929535 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.929537 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.929665 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.930328 (+ 663us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.930470 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 04:53:05.931133 11030 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } attempt: 3
I20260811 04:53:05.931582 11117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } has no permanent_uuid. Determining permanent_uuid...
I20260811 04:53:05.932124 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.921766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34662 (local address 127.17.188.126:41551)
0811 04:53:05.921871 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.921875 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.922083 (+ 208us) server_negotiation.cc:407] Connection header received
0811 04:53:05.922170 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.922173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.922221 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.922294 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.922847 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.923302 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.924257 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.924500 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.924575 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.927367 (+ 2792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.927370 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.927373 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.927399 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.929490 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.930056 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.930061 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.930065 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.930155 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.930464 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.930468 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.930472 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.930744 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.931101 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.931809 (+ 708us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.931934 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.126@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.124@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.17.188.125@KRBTEST.COM
Aug 11 04:53:05 dist-test-slave-njxd krb5kdc[10860](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786423985, etypes {rep=17 tkt=17 ses=17}, kudu/127.17.188.125@KRBTEST.COM for kudu/127.17.188.124@KRBTEST.COM
I20260811 04:53:05.943873 10949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.927040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37438)
0811 04:53:05.927220 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.927236 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.927316 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.928242 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.928246 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.928427 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.928554 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.928565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.929527 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.929530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.930313 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.930326 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.932850 (+ 2524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.932855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.932952 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.933956 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.933971 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.936238 (+ 2267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.940257 (+ 4019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.940261 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.940264 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.940545 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.942044 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.942047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.942050 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.942169 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.943339 (+ 1170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.943342 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.943436 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.943520 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.943659 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 04:53:05.944866 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.933346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44094 (local address 127.17.188.125:36843)
0811 04:53:05.933470 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.933474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.933487 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:53:05.933562 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.933565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.933627 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.933712 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.935313 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.936016 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.937156 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.937532 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.937651 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.940614 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.940617 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.940620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.940643 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.942448 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.943032 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.943037 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.943040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.943125 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.943488 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.943492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.943494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.943745 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.943964 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.944568 (+ 604us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.944685 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:53:05.945478 11121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.927091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37438 (local address 127.17.188.124:36687)
0811 04:53:05.927993 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.927998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.928011 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:53:05.928044 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.928046 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.928090 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.928217 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.928680 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.929400 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.930502 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.932470 (+ 1968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.933155 (+ 685us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.936381 (+ 3226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.936385 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.936388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.936411 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.939723 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.941858 (+ 2135us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.941861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.941863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.941936 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.942294 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.942298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.942301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.942566 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.944159 (+ 1593us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.944257 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.945294 (+ 1037us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":824}
I20260811 04:53:05.945998 11119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.932041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37446)
0811 04:53:05.932621 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.932635 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.932716 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.933024 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.933029 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.933205 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.933297 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.933304 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.934813 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.934818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.935636 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.935647 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.936367 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.936370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.936455 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.936892 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.936910 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.938477 (+ 1567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.941445 (+ 2968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.941448 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.941451 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.941732 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.942867 (+ 1135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.942869 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.942871 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.942996 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.944636 (+ 1640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.944639 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.944703 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.944806 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.945853 (+ 1047us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":908}
I20260811 04:53:05.946166 11122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.932234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37446 (local address 127.17.188.124:36687)
0811 04:53:05.932562 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.932571 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.932748 (+ 177us) server_negotiation.cc:407] Connection header received
0811 04:53:05.932790 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.932793 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.932834 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.932916 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.933416 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.934705 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.935760 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.936171 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.936275 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.938599 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.938602 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.938605 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.938625 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.941339 (+ 2714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.942675 (+ 1336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.942680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.942685 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.942765 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.943099 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.943102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.943104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.944506 (+ 1402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.944599 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.944865 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.946010 (+ 1145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1033,"server-negotiator.queue_time_us":262,"thread_start_us":109,"threads_started":1}
I20260811 04:53:05.947939 11033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.935257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.17.188.124:36687 (local address 127.0.0.1:37460)
0811 04:53:05.935472 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 04:53:05.935485 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 04:53:05.935551 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 04:53:05.936299 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 04:53:05.936302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 04:53:05.936472 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0811 04:53:05.937036 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.937051 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.938852 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.938858 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.939739 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 04:53:05.939751 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.940775 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.940781 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 04:53:05.941146 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.941789 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 04:53:05.941807 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 04:53:05.943247 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 04:53:05.946279 (+ 3032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.946283 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.946285 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.946537 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.946974 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 04:53:05.946977 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 04:53:05.946979 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 04:53:05.947069 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 04:53:05.947458 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 04:53:05.947461 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 04:53:05.947556 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 04:53:05.947661 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 04:53:05.947790 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260811 04:53:05.947975 11123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.935668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37460 (local address 127.17.188.124:36687)
0811 04:53:05.936074 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.936082 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.936094 (+ 12us) server_negotiation.cc:407] Connection header received
0811 04:53:05.936126 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.936128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.936168 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.937166 (+ 998us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.937278 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.938702 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.940015 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.940639 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.943359 (+ 2720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.943452 (+ 93us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.943456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.943458 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.943475 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.945533 (+ 2058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.946778 (+ 1245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.946781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.946783 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.946863 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.947170 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.947172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.947173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.947372 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.947464 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.947724 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.947826 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":82,"threads_started":1}
I20260811 04:53:05.948576 18161 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 04:53:05.949473 10946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: Bootstrap starting.
I20260811 04:53:05.952214 10946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:05.952548 11117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: Bootstrap starting.
I20260811 04:53:05.952987 10946 log.cc:824] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:05.955219 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: Bootstrap starting.
I20260811 04:53:05.955274 11117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:05.956116 11117 log.cc:824] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:05.957317 11030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: Neither blocks nor log segments found. Creating new log.
I20260811 04:53:05.958020 10946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: No bootstrap required, opened a new log
I20260811 04:53:05.958151 11030 log.cc:824] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: Log is configured to *not* fsync() on all Append() calls
I20260811 04:53:05.949673 10917 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9ff55d78685b48338d8b00db263e0c3a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34662
I20260811 04:53:05.962074 10946 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.962339 10946 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ff55d78685b48338d8b00db263e0c3a, State: Initialized, Role: FOLLOWER
I20260811 04:53:05.962664 10946 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.962821 11030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: No bootstrap required, opened a new log
I20260811 04:53:05.963165 11128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:05.963299 11128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:05.963994 10946 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:05.964668 10917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 04:53:05.964789 10917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:05.966216 10917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.968403 10917 leader_election.cc:288] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [CANDIDATE]: Term 1 election: Requested vote from peers 38f03508b6d840ffae7a8f3c91c05d94 (127.17.188.125:36843), 19516e0991264821b4d5f44c66535dec (127.17.188.124:36687)
I20260811 04:53:05.970521 11030 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.970921 11030 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38f03508b6d840ffae7a8f3c91c05d94, State: Initialized, Role: FOLLOWER
W20260811 04:53:05.971069 11139 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:05.971156 11139 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:05.971431 11030 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.972118 11145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:05.972471 11145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:05.973122 11030 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:05.973213 11003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff55d78685b48338d8b00db263e0c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "38f03508b6d840ffae7a8f3c91c05d94"
I20260811 04:53:05.973443 11003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:05.975039 11003 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff55d78685b48338d8b00db263e0c3a in term 1.
I20260811 04:53:05.971010 10873 master_runner.cc:186] Error getting master registration for 127.17.188.125:36843: OK, instance_id { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" instance_seqno: 1786423985666574 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:53:05.975564 10890 leader_election.cc:302] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38f03508b6d840ffae7a8f3c91c05d94, 9ff55d78685b48338d8b00db263e0c3a; no voters:
I20260811 04:53:05.977412 11117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: No bootstrap required, opened a new log
W20260811 04:53:05.978096 11159 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:05.978183 11159 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:05.981453 10953 master_runner.cc:186] Error getting master registration for 127.17.188.124:36687: OK, instance_id { permanent_uuid: "19516e0991264821b4d5f44c66535dec" instance_seqno: 1786423985894510 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 04:53:05.978456 10873 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 04:53:05.986444 11128 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 04:53:05.986680 11128 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [term 1 LEADER]: Becoming Leader. State: Replica: 9ff55d78685b48338d8b00db263e0c3a, State: Running, Role: LEADER
I20260811 04:53:05.987006 11128 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.988423 10953 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 04:53:05.988888 11128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ff55d78685b48338d8b00db263e0c3a. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:05.989022 11128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:05.993638 11117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.994760 11117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19516e0991264821b4d5f44c66535dec, State: Initialized, Role: FOLLOWER
I20260811 04:53:05.996618 11117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } }
I20260811 04:53:05.997822 11167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:05.997974 11167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:06.000022 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.973745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34668 (local address 127.17.188.126:41551)
0811 04:53:05.973880 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.973886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.984001 (+ 10115us) server_negotiation.cc:407] Connection header received
0811 04:53:05.984178 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.984181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.984227 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.984276 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.985249 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.986107 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.993672 (+ 7565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.994010 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.994083 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:05.996063 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:05.996066 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:05.996069 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:05.996096 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:05.998039 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.998657 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.998661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.998663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.998764 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:05.999065 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:05.999068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:05.999070 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:05.999274 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:05.999395 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:05.999744 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 04:53:05.999867 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 04:53:06.003109 11086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9ff55d78685b48338d8b00db263e0c3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "19516e0991264821b4d5f44c66535dec"
I20260811 04:53:06.004032 11086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [term 0 FOLLOWER]: Advancing to term 1
I20260811 04:53:06.005435 11086 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9ff55d78685b48338d8b00db263e0c3a in term 1.
I20260811 04:53:06.003042 11117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 04:53:06.010339 11166 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260811 04:53:06.011831 11179 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 04:53:06.011907 11179 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 04:53:06.012343 11037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.979405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44106 (local address 127.17.188.125:36843)
0811 04:53:05.979527 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.979533 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.980497 (+ 964us) server_negotiation.cc:407] Connection header received
0811 04:53:05.980553 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.980558 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.980609 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.980741 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:05.986614 (+ 5873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.987329 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.995946 (+ 8617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:05.996334 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:05.996421 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:06.005930 (+ 9509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:06.005935 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:06.005938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:06.005968 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:06.007839 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:06.010059 (+ 2220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:06.010063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:06.010065 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:06.010182 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:06.011364 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:06.011367 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:06.011369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:06.011595 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:06.011721 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:06.012058 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 04:53:06.012184 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 04:53:06.013162 11166 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 04:53:06.016572 11123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:05.980014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37474 (local address 127.17.188.124:36687)
0811 04:53:05.980419 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:05.980427 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:05.980468 (+ 41us) server_negotiation.cc:407] Connection header received
0811 04:53:05.980876 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:05.980895 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:05.980943 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:05.981023 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.000725 (+ 19702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:06.001506 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:06.008515 (+ 7009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:06.008839 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:06.008928 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:06.010871 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 04:53:06.010874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 04:53:06.010877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 04:53:06.010904 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 04:53:06.013001 (+ 2097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:06.015067 (+ 2066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:06.015071 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:06.015074 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:06.015180 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 04:53:06.015562 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 04:53:06.015566 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 04:53:06.015568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 04:53:06.015786 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 04:53:06.015920 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:06.016304 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 04:53:06.016430 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338}
I20260811 04:53:06.019568 11003 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [term 1 FOLLOWER]: Refusing update from remote peer 9ff55d78685b48338d8b00db263e0c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:53:06.021134 11086 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [term 1 FOLLOWER]: Refusing update from remote peer 9ff55d78685b48338d8b00db263e0c3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 04:53:06.022466 11128 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:53:06.022912 11128 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 04:53:06.034086 11145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ff55d78685b48338d8b00db263e0c3a. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.034184 11167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ff55d78685b48338d8b00db263e0c3a. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.034307 11167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:06.035107 11145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:06.046862 11128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.047008 11128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:06.047433 11181 mvcc.cc:205] Tried to move back new op lower bound from 7317192646725365760 to 7317192646606483456. Current Snapshot: MvccSnapshot[applied={T|T < 7317192646725365760}]
I20260811 04:53:06.047531 11167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.047636 11167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:06.048277 11182 mvcc.cc:205] Tried to move back new op lower bound from 7317192646725365760 to 7317192646606483456. Current Snapshot: MvccSnapshot[applied={T|T < 7317192646725365760}]
I20260811 04:53:06.053499 11164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.053786 11164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a [sys.catalog]: This master's current role is: LEADER
I20260811 04:53:06.054538 11183 mvcc.cc:205] Tried to move back new op lower bound from 7317192646725365760 to 7317192646606483456. Current Snapshot: MvccSnapshot[applied={T|T < 7317192646725365760}]
I20260811 04:53:06.054981 11166 catalog_manager.cc:1347] Generated new cluster ID: 0418276cb8624f5eb4a22c3a5758cb66
I20260811 04:53:06.055049 11166 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 04:53:06.055150 11145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9ff55d78685b48338d8b00db263e0c3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ff55d78685b48338d8b00db263e0c3a" member_type: VOTER last_known_addr { host: "127.17.188.126" port: 41551 } } peers { permanent_uuid: "38f03508b6d840ffae7a8f3c91c05d94" member_type: VOTER last_known_addr { host: "127.17.188.125" port: 36843 } } peers { permanent_uuid: "19516e0991264821b4d5f44c66535dec" member_type: VOTER last_known_addr { host: "127.17.188.124" port: 36687 } } }
I20260811 04:53:06.055352 11145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 04:53:06.092393 11166 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 04:53:06.093763 11166 catalog_manager.cc:1504] Loading token signing keys...
I20260811 04:53:06.102144 11166 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ff55d78685b48338d8b00db263e0c3a: Generated new TSK 0
I20260811 04:53:06.103041 11166 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 04:53:06.175120 10950 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.163003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34680 (local address 127.17.188.126:41551)
0811 04:53:06.163139 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.163144 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.173889 (+ 10745us) server_negotiation.cc:407] Connection header received
0811 04:53:06.174104 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.174108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.174163 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.174217 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.174988 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34680: BlockingRecv error: recv got EOF from 127.0.0.1:34680 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 04:53:06.176568 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.165949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44110 (local address 127.17.188.125:36843)
0811 04:53:06.166063 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.166067 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.175695 (+ 9628us) server_negotiation.cc:407] Connection header received
0811 04:53:06.175873 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.175876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.175926 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.175976 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.176449 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44110: BlockingRecv error: recv got EOF from 127.0.0.1:44110 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 04:53:06.178376 11123 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.166419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37482 (local address 127.17.188.124:36687)
0811 04:53:06.166528 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.166533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.176960 (+ 10427us) server_negotiation.cc:407] Connection header received
0811 04:53:06.177521 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.177524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.177581 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.177690 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.178263 (+ 573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37482: BlockingRecv error: recv got EOF from 127.0.0.1:37482 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260811 04:53:06.207325 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.194129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.17.188.125:36843)
0811 04:53:06.194270 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.194276 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.205965 (+ 11689us) server_negotiation.cc:407] Connection header received
0811 04:53:06.206297 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.206301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.206404 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.206471 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.207189 (+ 718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44120: BlockingRecv error: recv got EOF from 127.0.0.1:44120 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 04:53:06.224197 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.214378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44128 (local address 127.17.188.125:36843)
0811 04:53:06.214496 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.214500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.222228 (+ 7728us) server_negotiation.cc:407] Connection header received
0811 04:53:06.223350 (+ 1122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.223354 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.223417 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.223473 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.224065 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44128: BlockingRecv error: recv got EOF from 127.0.0.1:44128 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260811 04:53:06.245114 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.238150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44132 (local address 127.17.188.125:36843)
0811 04:53:06.238314 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.238320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.243676 (+ 5356us) server_negotiation.cc:407] Connection header received
0811 04:53:06.243980 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.243986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.244076 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.244142 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.244936 (+ 794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44132: BlockingRecv error: recv got EOF from 127.0.0.1:44132 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 04:53:06.263543 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.258188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44138 (local address 127.17.188.125:36843)
0811 04:53:06.258392 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.258399 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.262431 (+ 4032us) server_negotiation.cc:407] Connection header received
0811 04:53:06.262686 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.262690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.262757 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.262814 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.263419 (+ 605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44138: BlockingRecv error: recv got EOF from 127.0.0.1:44138 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
W20260811 04:53:06.276068 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.274434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44150 (local address 127.17.188.125:36843)
0811 04:53:06.274561 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.274565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.275108 (+ 543us) server_negotiation.cc:407] Connection header received
0811 04:53:06.275304 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.275307 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.275360 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.275410 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.275952 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44150: BlockingRecv error: recv got EOF from 127.0.0.1:44150 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260811 04:53:06.296133 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.294865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44154 (local address 127.17.188.125:36843)
0811 04:53:06.295035 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.295043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.295146 (+ 103us) server_negotiation.cc:407] Connection header received
0811 04:53:06.295287 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.295293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.295373 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.295495 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.295969 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44154: BlockingRecv error: recv got EOF from 127.0.0.1:44154 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 04:53:06.331583 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.330199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44160 (local address 127.17.188.125:36843)
0811 04:53:06.330362 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.330366 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.330620 (+ 254us) server_negotiation.cc:407] Connection header received
0811 04:53:06.330771 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.330774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.330821 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.330894 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.331440 (+ 546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44160: BlockingRecv error: recv got EOF from 127.0.0.1:44160 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 04:53:06.399653 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.398286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.17.188.125:36843)
0811 04:53:06.398472 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.398479 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.398720 (+ 241us) server_negotiation.cc:407] Connection header received
0811 04:53:06.398855 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.398861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.398938 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.399045 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.399493 (+ 448us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44172: BlockingRecv error: recv got EOF from 127.0.0.1:44172 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 04:53:06.531247 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.530170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44186 (local address 127.17.188.125:36843)
0811 04:53:06.530306 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.530310 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.530429 (+ 119us) server_negotiation.cc:407] Connection header received
0811 04:53:06.530585 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.530588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.530639 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.530706 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.531134 (+ 428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44186: BlockingRecv error: recv got EOF from 127.0.0.1:44186 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 04:53:06.790681 11037 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 04:53:06.789675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44202 (local address 127.17.188.125:36843)
0811 04:53:06.789818 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:06.789821 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:06.789889 (+ 68us) server_negotiation.cc:407] Connection header received
0811 04:53:06.790037 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:06.790040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:06.790096 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:06.790180 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 04:53:06.790583 (+ 403us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44202: BlockingRecv error: recv got EOF from 127.0.0.1:44202 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 04:53:06.979467 11159 catalog_manager.cc:1259] Loaded cluster ID: 0418276cb8624f5eb4a22c3a5758cb66
I20260811 04:53:06.979600 11159 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: loading cluster ID for follower catalog manager: success
I20260811 04:53:06.981272 11159 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: acquiring CA information for follower catalog manager: success
I20260811 04:53:06.982448 11159 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38f03508b6d840ffae7a8f3c91c05d94: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:53:07.013223 11179 catalog_manager.cc:1259] Loaded cluster ID: 0418276cb8624f5eb4a22c3a5758cb66
I20260811 04:53:07.013304 11179 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: loading cluster ID for follower catalog manager: success
I20260811 04:53:07.015074 11179 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: acquiring CA information for follower catalog manager: success
I20260811 04:53:07.016219 11179 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 19516e0991264821b4d5f44c66535dec: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 04:53:07.308840 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:07.304846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44206 (local address 127.17.188.125:36843)
0811 04:53:07.305100 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:07.305103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:07.305123 (+ 20us) server_negotiation.cc:407] Connection header received
0811 04:53:07.305269 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:07.305272 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:07.305411 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:07.305525 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:07.305771 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.306386 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.307273 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.307589 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.307708 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:07.307988 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:07.308493 (+ 505us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:07.308631 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:07.308664 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 04:53:07.308717 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":99,"threads_started":1}
I20260811 04:53:07.315579 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:07.311811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37494 (local address 127.17.188.124:36687)
0811 04:53:07.312050 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:07.312053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:07.312066 (+ 13us) server_negotiation.cc:407] Connection header received
0811 04:53:07.312241 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:07.312244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:07.312349 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:07.312434 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:07.312582 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.313080 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.313941 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.314159 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.314279 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:07.314589 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:07.315121 (+ 532us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:07.315252 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:07.315335 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 04:53:07.315405 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260811 04:53:07.322875 11265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:07.319482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37508 (local address 127.17.188.124:36687)
0811 04:53:07.319588 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:07.319594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:07.319794 (+ 200us) server_negotiation.cc:407] Connection header received
0811 04:53:07.319982 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:07.319988 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:07.320052 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:07.320135 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:07.320360 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.320856 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.321879 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.322103 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.322206 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:07.322452 (+ 246us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:07.322517 (+ 65us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:07.322594 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:07.322685 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 04:53:07.322734 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 04:53:07.323662 11259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:07.318840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.17.188.125:36843)
0811 04:53:07.318962 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:07.318969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:07.319181 (+ 212us) server_negotiation.cc:407] Connection header received
0811 04:53:07.319376 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:07.319382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:07.319441 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:07.319501 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:07.319883 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.320799 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.322261 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.322586 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.322670 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:07.323119 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:07.323199 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:07.323273 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:07.323476 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 04:53:07.323547 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 04:53:07.324189 11274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 04:53:07.318851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34684 (local address 127.17.188.126:41551)
0811 04:53:07.319075 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 04:53:07.319080 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 04:53:07.319435 (+ 355us) server_negotiation.cc:407] Connection header received
0811 04:53:07.319553 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 04:53:07.319556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 04:53:07.319684 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 04:53:07.319807 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 04:53:07.320068 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.320884 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.322268 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 04:53:07.322617 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 04:53:07.322708 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 04:53:07.323340 (+ 632us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 04:53:07.323744 (+ 404us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 04:53:07.323835 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 04:53:07.323984 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 04:53:07.324040 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":73,"threads_started":1}
I20260811 04:53:07.327018 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10873
I20260811 04:53:07.336391 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 10953
I20260811 04:53:07.344501 18161 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task9CJn4q/build/debug/bin/kudu with pid 11038
2026-08-11T04:53:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3308 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6470 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (292042 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST